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Chapter Vignette: “If It Quacks Like a Duck?” 


“If you're hurt and you miss work”: This is the tag line for one of the most popular U.S. advertis- 


ing campaigns—for AFLAC Insurance. The tag line is accompanied by the familiar Pekin duck 
constantly reminding people with a loud “AFFLLAACKK!!” Recent polls show that the 


= 
AFLAC duck has become one of America’s favorite icons, 
coming in second only to the Mars 


M&Ms characters. But how 
has the duck's favorable fan 
status affected AFLAC’s busi- 
ness performance? Certainly, 
=] AFLAC’s business strategy 
goes beyond creating the most 
popular duck since Donald! 
Throughout its thirty-year 
history, AFLAC, like other firms, 
has faced important business 
decisions about how to cre- 
ate brand awareness, how to 
build consumer knowledge of 
the brand, and how to build 
sales and loyalty. Leading up to 
these decisions, the firm must first 
assess its current situation and 
its brand awareness relative to its 
competitors. Approximately two 
dozen AFLAC duck commercials ago, 
research revealed that most consum- 
ers were unaware of AFLAC. The vast 
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majority of consumers would not list AFLAC when prompted to name insurance companies. 
Instead, names like Allstate, State Farm, and Prudential proved more familiar. Not surprisingly, 
these companies enjoyed greater market share. Based on this research, AFLAC decided to invest 
in a national television campaign to build awareness of the brand name—“AFFLLAAACCK!!” The 
phonic similarity to “QUACK” proved successful. 
Today, AFLAC has built great awareness of its name, but this hasn’t necessarily translated into 
business success. Despite the tag line, fewer than 30 percent of consumers who recognize the name 
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know that AFLAC specializes in supplemental disability insurance. This accounts for over three-fourths 

of AFLAC’s nearly $14 billion annual revenue. Thus, while the initial research suggested the need for 
building awareness, their more recent research is addressing difficulties in creating the right knowledge 
of AFLAC. What communication strategy is best for building knowledge? Can knowledge be built in the 
same way as awareness? Will knowledge lead to increased intentions to do business with AFLAC? What 
role does the company play compared to the AFLAC sales associates in creating company image? All of 
these are questions that should be answered. Business research will be directed toward answering these 
questions. The information will then be used to try and erase the knowledge deficit faced by AFLAC. If the 
answers are half as effective as those that led to the AFLAC duck, the company should enjoy tremendous 
success. Thus, for AFLAC, as for many firms, research is an important tool in shaping business strategy.’ 


Introduction 


The recent history of AFLAC demonstrates the need for information in making informed deci- 
sions addressing key issues faced by all competitive businesses. Research can provide that informa- 
tion. Without it, business decisions involving both tactics and strategies are made in the dark. 

We open with three examples illustrating how business decisions require intelligence and how 
research can provide that intelligence. The following examples focus specifically on how research 
can lead to innovation in the form of new products, improvements in existing goods and services, 
or enhancements in employee relationships. Imagine yourself in the role of business manager as 
you read these examples and think about the information needs you may have in trying to build 
success for your company. 

Jelly Belly brand traditionally offered fifty official jelly bean flavors. However, research input 
from customers has helped that number grow and now Jelly Belly even has a variety of specialty 
beans. Consumers willingly submitted new flavor ideas as part of the Jelly Belly Dream Bean 
Contest (http://www.dreambeancontest.com). In return, the consumers received an opportunity to win 
prizes. The company receives some really off-the-wall flavor ideas. Among the strangest are flavors 
such as Dill Pickle, Rotten Egg, Taco, Burned Bacon, and Cream of Wheat.’ Top suggestions were 
put back on the Web so that people could vote for the flavor they most wanted to see introduced. 
In 2008, the winning flavor was Acai Berry, which beat out other finalist flavors such as Sublime 
Chili Lime, Thai Iced Tea, and Mojito. 

More recently, Jelly Belly is trying to capitalize on consumers’ desires for sports performance 
products. Survey research suggests that consumers would respond favorably to food and drink 
products providing benefits that improve one’s ability to exercise.” As a result, Jelly Belly has intro- 
duced Sport Beans. Sport Beans 
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As a user of this book, you can take part in a real business survey. In later chapters, your instructor will pro- 
research survey. In each chapter, we'll refer back to some aspect vide you with a way to access not only the data 
of this survey to illustrate key points about business research. from your particular class, but also data from all 
For instance, we can easily illustrate different types of survey users. This data can be used to illustrate some of 
approaches by referring back to some question contained inthe the analytical approaches discussed in the clos- 


COURTESY OF QUALTRICS.COM 


ing chapters of the book. For now, your 

instructor will provide you with instructions to access the 
questionnaire via the Internet. As a first step in this process, 
simply respond to the items in the questionnaire just as 
you would to any other research survey. 


Successful companies are constantly scanning ideas in 
the hope of providing ways of adding value. Jelly Belly’s 
Sports Beans and Bean-Boozled Beans offer two different 
ways of adding value.* 

The coffee industry, after years of the “daily grind,” 
has proved quite dynamic over the past decade. After years 
of steady decline, research on consumers’ beverage pur- 
chases show that coffee sales began rebounding around 
1995. Telephone interviews with American consumers 
estimated that there were 80 million occasional coffee 
drinkers and 7 million daily upscale coffee drinkers in 1995. By 2001, estimates suggested there were 
161 million daily or occasional U.S. coffee drinkers and 27 million daily upscale coffee drinkers.* 

Coffee drinking habits have also changed. In 1991 there were fewer than 450 coffeehouses in 
the United States. Today, it seems like places such as Starbucks, Second Cup, The Coffee Bean & 
Tea Leaf, and Gloria Jean’s are virtually everywhere in the United States and Canada. There are 
more than 15,000 thousand Starbucks locations around the world with the majority of these being 
wholly owned stores. While locating these outlets requires significant formal research, Starbucks 
also is researching new concepts aimed at other ways a coffee shop can provide value to consum- 
ers. One concept that has survived testing thus far is the addition of free, in-store high-speed 
wireless Internet access. Thus, you can have hot coffee in a hot spot! After Starbucks baristas began 
reporting that customers were asking clerks what music was playing in the stores, Starbucks began 
testing the sales of CDs containing their in-store music. In 2009, Starbucks began a bundled pric- 
ing promotion offering a breakfast sandwich or pastry and a tall coffee drink for $3.95 in response 
to the declining economy. The research that underlies the introduction of these value-added 
concepts could first include simply asking a consumer or a small group of consumers for their 
reaction to the concept. Survey research and then actual in-store tests may follow. So, the research 
underlying such decisions can be multilayered. 

Often, business research is directed toward an element of an organization’s internal operations. 
For example, DuPont utilizes research techniques to better understand their employees’ needs. 
DuPont has ninety-four thousand employees worldwide and fifty-four thousand in the United 
States.” The company has conducted four comprehensive work/life needs assessment surveys of its 
employees since 1985. This business research provides the company with considerable insight into 
employee work/life behavior and allows DuPont to identify trends regarding employee needs. 

The most recent survey found that, as the company’s work force is aging, employees’ child care 
needs are diminishing, but elder care needs are emerging. The survey found that 88 percent of respon- 
dents identified themselves as baby boomers. About 50 percent of the employees say that they have— 
or expect to have—elder care responsibilities in the next three to four years, up from 40% in 1995. 

The surveys have shown that DuPont employees want to balance work and family respon- 
sibilities, feeling deeply committed to both aspects of their lives. The latest research shows that 
company efforts to satisfy these desires have been successful. Employee perception of support from 
management for work/life issues improved from the 1995 study and the results indicate employees 
feel less stress. Support from colleagues is rated high, and women indicated they now have more 
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role models. The study also reported that the feeling of management support is directly connected 
to employees’ efforts to make the company successful. Employees who use the work/life programs 
are willing to “go the extra mile.” 

These examples illustrate the need for information in making informed business decisions. Jelly 
Belly provides consumers with the incentive of free samples of jelly beans in return for ideas about 
desirable new bean flavors. The statistics about coffee demonstrate how research can track trends 
that may lead to new business opportunities. Starbucks’s research also illustrates how research can 
be used to examine new concepts in progressively more complex stages, setting the stage for a 
more successful product introduction. DuPont’s ability to track employee attitudes allows them to 
adjust employee benefit packages to maximize satisfaction and reduce employee turnover. These 
are only the tip of the iceberg when it comes to the types of business research that are conducted 
every day. This chapter introduces basic concepts of business research and describes how research 
can play a crucial role in creating and managing a successful business. 


The Nature of Business Research 


Business research covers a wide range of phenomena. For managers, the purpose of research is 
to provide knowledge regarding the organization, the market, the economy, or another area of 
uncertainty. A financial manager may ask, “Will the environment for long-term financing be bet- 
ter two years from now?” A personnel manager may ask, “What kind of training is necessary for 
production employees?” or “What is the reason for the company’s high employee turnover?” A 
marketing manager may ask, “How can I monitor my retail sales and retail trade activities?” Each 
of these questions requires information about how the environment, employees, customers, or the 
economy will respond to executives’ decisions. Research is one of the principal tools for answer- 
ing these practical questions. 

Within an organization, a business researcher may be referred to as a marketing researcher, 
an organizational researcher, a director of financial and economic research, or one of many other 
titles. Although business researchers are often specialized, the term business research encompasses all 
of these functional specialties. While researchers in different functional areas may investigate dif- 
ferent phenomena, they are similar to one another because they share similar research methods. 

It’s been said that “every business issue ultimately boils down to an information problem.”* 
Can the right information be delivered? The ultimate goal of research is to supply accurate infor- 
mation that reduces the uncertainty in managerial decision making. Very often, decisions are 
made with little information for various reasons, including cost considerations, insufficient time to 
conduct research, or management’s belief that enough is already known. Relying on seat-of-the- 
pants decision making—decision making without research—is like betting on a long shot at the 
racetrack because the horse’s name is appealing. Occasionally there are successes, but in the long 
run, intuition without research leads to losses. Business research helps decision makers shift from 
intuitive information gathering to systematic and objective investigation. 


Business Research Defined 


Business research is the application of the scientific method in searching for the truth about busi- 
ness phenomena. These activities include defining business opportunities and problems, generat- 
ing and evaluating alternative courses of action, and monitoring employee and organizational 
performance. Business research is more than conducting surveys.’ This process includes idea and 
theory development, problem definition, searching for and collecting information, analyzing data, 
and communicating the findings and their implications. 

This definition suggests that business research information is not intuitive or haphazardly gath- 
ered. Literally, research (re-search) means “to search again.” The term connotes patient study and 
scientific investigation wherein the researcher takes another, more careful look at the data to discover 
all that is known about the subject. Ultimately, all findings are tied back to the underlying theory. 

The definition also emphasizes, through reference to the scientific method, that any infor- 
mation generated should be accurate and objective. The nineteenth-century American humorist 
Artemus Ward claimed, “It ain’t the things we don’t know that gets us in trouble. It’s the things 
we know that ain’t so.” In other words, research isn’t performed to support preconceived ideas 
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Good Fat and Bad Fat 2. Ifthe saturated fat amount includes 


American consumers can be seen every day scouring a specific line indicating the amount 

nutrition labels. Most likely, the item they show the most of “saturated fat” that is really trans 

interest in recently is the amount of fat. The Food and Drug fat, would consumers become more 

Administration (FDA) is concerned that consumers get informa- confused about their diet? 

tion that is not only accurate, but that also conveys the proper 3. If all amounts of fat are given equal 

message to achieve a healthy diet. But all fat is not created prominence on the label, will consumer attitudes toward the 
equal. In particular, dieticians warn of the dangers associated different types of fats be the same? 

with excess amounts of trans fats; diet nutrition labels break 4. Will consumers interpret foods free of trans fats as healthy? 


fats into saturated and unsaturated fats. Among numerous 
factors that complicate the interpretation of the nutrition label, 
trans fat (hydrogenated) is technically a nonsaturated fat, but 
it acts more like a saturated fat when consumed. So, where 
should it be placed? The FDA cannot address this problem 
intelligently without research addressing questions such as 

the following: 


Making this even more complicated is the fact that some con- 
sumer segments, such as teenagers in this case, may actually use 
the nutrition labels to select the brands that are least nutritious 
rather than most nutritious. So, they may actually seek out the 
one with the worst proportion of trans fats! The FDA specifically 
addressed trans fats in labeling regulations that took effect in 
2006. Under these regulations, the FDA allows labels to claim 

1. If trans fats are listed as zero trans fat as long as less than half a gram of hydrogenated oil 
saturated fats, would con- per serving is contained. Simple? 

sumers’ beliefs about their Sources: “Health Labels are in the Eye of the Beholder,” Food Management 40 
consumption become more (January 2005), 80; Hunter, B. T., “Labeling Transfat Is Tricky,” Consumers’ Research 


negative? Magazine 86 (July 2003), 8-10; Weise, E., “Food Labels Now Required to Mention 
Trans Fat, Allergens,” USA Today (January 2, 2006), H1. 
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but to test them. The researcher must be personally detached and free of bias in attempting to find 
truth. If bias enters into the research process, the value of the research is considerably reduced. We 
will discuss this further in a subsequent chapter. 

Our definition makes it clear that business research is designed to facilitate the managerial 
decision-making process for all aspects of the business: finance, marketing, human resources, and 
so on. Business research is an essential tool for management in virtually all problem-solving and 
decision-making activities. By providing the necessary information on which to base business 
decisions, research can decrease the risk of making a wrong decision in each area. However, it is 
important to note that research is an aid to managerial decision making, never a substitute for it. 

Finally, this definition of business research is limited by one’s definition of business. Certainly, 
research regarding production, finance, marketing, and management in for-profit corporations 
like DuPont is business research. However, business research also includes efforts that assist non- 
profit organizations such as the American Heart Association, the San Diego Zoo, the Boston Pops 
Orchestra, or a parochial school. Further, governmental agencies such as the Federal Emergency 
Management Agency (FEMA) and the Department of Homeland Security (DHS) perform many 
functions that are similar, if not identical, to those of for-profit business organizations. For instance, 
the Food and Drug Administration (FDA) is an important user of research, employing it to address 
the way people view and use various food and drugs. One such study commissioned and funded 
research to address the question of how consumers used the risk summaries that are included with 
all drugs sold in the United States.'° Therefore, not-for-profits and governmental agencies can use 
research in much the same way as managers at Starbucks, Jelly Belly, or DuPont. While the focus is 
on for-profit organizations, this book explores business research as it applies to all institutions. 


Applied and Basic Business Research 


applied business research On€ useful way to describe research is based on the specificity of its purpose. Applied business 


Research conducted to addres, "esearch is conducted to address a specific business decision for a specific firm or organization. The 


a specific business decision fora Opening vignette describes a situation in which AFLAC may use applied research to decide how 
specific firm or organization. to best create knowledge of its supplemental disability insurance products. 
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Basic business research (sometimes referred to as pure research) is conducted without a specific 
decision in mind, and it usually does not address the needs of a specific organization. It attempts to 
expand the limits of knowledge in general, and as such it is not aimed at solving a particular prag- 
matic problem. Basic research can be used to test the validity of a general business theory (one that 
applies to all businesses) or to learn more about a particular business phenomenon. For instance, 
a great deal of basic research addresses employee motivation. How can managers best encourage 
workers to dedicate themselves toward the organization’s goals? From such research, we can learn 
the factors that are most important to workers and how to create an environment where employ- 
ees are most highly motivated. This basic research does not examine the problem from any single 
organization’s perspective. However, AFLAC, Starbucks, or DuPont’s management may become 
aware of such research and use it to design applied research studies examining questions about 
their own employees. Thus, the two types of research are not completely independent, as basic 
research often provides the foundation for later applied research. 

While the distinction between basic and applied is useful in describing research, there are very 
few aspects of research that apply only to basic or only to applied research. We will use the term 
business research more generally to refer to either type of research. The focus of this text is more on 
applied research—studies that are undertaken to answer questions about specific problems or to 
make decisions about particular courses of action or policies. Applied research is emphasized in this 
text because most students will be oriented toward the day-to-day practice of management, and 
most students and researchers will be exposed to short-term, problem-solving research conducted 
for businesses or nonprofit organizations. 


The Scientific Method 


All research, whether basic or applied, involves the scientific method. The scientific method is the 
way researchers go about using knowledge and evidence to reach objective conclusions about the 
real world. The scientific method is the same in social sciences, such as business, as in physical 
sciences, such as physics. In this case, it is the way we come to understand business phenomena. 

Exhibit 1.1 briefly illustrates the scientific method. In the scientific method, there are mul- 
tiple routes to developing ideas. When the ideas can be stated in researchable terms, we reach the 
hypothesis stage. The next step involves testing the hypothesis against empirical evidence (facts 
from observation or experimentation). The results either support a hypothesis or do not support a 
hypothesis. From these results, new knowledge is generated. 


Prior 


Knowledge Observation 


Hypotheses 


Hypothesis Test 
(Observation or 
Experimentation) 


Conclusion 
(New Knowledge) 


basic business research 


Research conducted without a 
specific decision in mind that 
usually does not address the 
needs of a specific organization. 
It attempts to expand the limits 
of knowledge in general and is 
not aimed at solving a particular 
pragmatic problem. 


the scientific method 


The way researchers go about 
using knowledge and evidence 
to reach objective conclusions 
about the real world. 


HIBIT 1.1 
A Summary of the Scientific 
Method 


product-oriented 


Describes a firm that prioritizes 
decision making in a way that 
emphasizes technical superiority 
in the product. 


production-oriented 


Describes a firm that prioritizes 
efficiency and effectiveness 

of the production processes in 
making decisions. 


Business Orientations 


marketing-oriented 


Describes a firm in which all 
decisions are made with a 
conscious awareness of their 
effect on the customer. 


Part 1: Introduction 


In basic research, testing these prior conceptions or hypotheses and then making inferences 
and conclusions about the phenomena leads to the establishment of general laws about the phe- 
nomena. Use of the scientific method in applied research ensures objectivity in gathering facts and 
testing creative ideas for alternative business strategies. The essence of research, whether basic or 
applied, lies in the scientific method. Much of this book deals with scientific methodology. Thus, 
the techniques of basic and applied research differ largely in degree rather than in substance. 


Managerial Value of Business Research 


In all of business strategy, there are only a few business orientations (see Exhibit 1.2). A firm can 
be product-oriented. A product-oriented firm prioritizes decision making in a way that emphasizes 
technical superiority in the product. Thus, research gathering information from technicians and 
experts in the field are very important in making critical decisions. A firm can be production-oriented. 
Production orientation means that the firm prioritizes efficiency and effectiveness of the production 
processes in making decisions. Here, research providing input from workers, engineers, finance, 
and accounting becomes important as the firm seeks to drive costs down. Production-oriented 
firms are usually very large firms manufacturing products in very large quantities. The third is 
marketing-oriented, which focuses more on how the firm provides value to customers than on 
the physical product or production process. With a marketing-oriented organization the majority 
of research focuses on the customer. Research addressing consumer desires, beliefs, and attitudes 
becomes essential. 


Product-Oriented Firm Example 

Prioritizes decision making that emphasizes the The fashion industry makes clothes in styles and 
physical product design, trendiness or technical sizes that few can adopt. 

superiority 


Research focuses on technicians and experts in the field. 


Production-Oriented Firm Example 
Prioritizes efficiency and effectiveness of the U.S. auto industry’s assembly-line process is intent 
production processes in making decisions on reducing costs of production as low as possible. 


Research focuses on line employees, engineers, accountants, and other efficiency experts. 


Marketing-Oriented Firm Example 

Focuses on how the firm provides value to Well-known hotel chains are designed to address 

customers the needs of travelers, particularly business 
travelers. 


Research focuses on customers. 


We have argued that research facilitates effective management. For example, Yoplait Go- 
Gurt illustrates the benefit of business research. The company’s consumer research about eating 
regular yogurt at school showed that moms and kids in their “tweens” wanted convenience and 
portability. Some brands, like Colombo Spoon in a Snap, offered the convenience of having a 
utensil as part of the packaging/delivery system. However, from what Yoplait learned about con- 
sumers, they thought kids would eat more yogurts if they could “lose the spoon” and eat yogurt 
anywhere, anytime. Moms and kids participating in a taste test were invited to sample different 
brand-on-the-go packaging shapes—long tubes, thin tubes, fat tubes, and other shapes—without 
being told how to handle the packaging. One of the company’s researchers said, “It was funny to 
see the moms fidget around, then daintily pour the product onto a spoon, then into their mouths. 
The kids instantly jumped on it. They knew what to do.”'' Squeezing Go-Gurt from the tube 
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was a big plus. The kids loved the fact that the packaging gave them permission to play with their 
food, something parents always tell them not to do. Based on their research, Yoplait introduced 
Go-Gurt in a three-sided tube designed to fit in kids’ lunchboxes. The results were spectacular, 
with more than $100 million in sales its first year on the market. Yoplait realized that knowledge 
of consumers’ needs, coupled with product research and development, leads to successful business 
strategies. 

As the Yoplait example shows, the prime managerial value of business research is that it 
provides information that improves the decision-making process. The decision-making process 
associated with the development and implementation of a business strategy involves four inter- 
related stages: 


1. Identifying problems or opportunities 

2. Diagnosing and assessing problems or opportunities 
3. Selecting and implementing a course of action 

4. Evaluating the course of action 


Business research, by supplying managers with pertinent information, may play an important role 
by reducing managerial uncertainty in each of these stages. 


Identifying Problems or Opportunities 


Before any strategy can be developed, an organization must determine where it wants to go and 
how it will get there. Business research can help managers plan strategies by determining the nature 
of situations or by identifying the existence of problems or opportunities present in the organiza- 
tion. Business research may be used as a scanning activity to provide information about what is 
occurring within an organization or in its environment. The mere description of some social or 
economic activity may familiarize managers with organizational and environmental occurrences 
and help them understand a situation. Consider these two examples: 


e The description of the dividend history of stocks in an industry may point to an attrac- 
tive investment opportunity. Information supplied by business research may also indicate 
problems. 

e Employee interviews undertaken to characterize the dimensions of an airline reservation 
clerk’s job may reveal that reservation clerks emphasize competence in issuing tickets over 
courtesy and friendliness in customer contact. 


Once business research indicates a problem or opportunity, managers may feel that the alter- 
natives are clear enough to make a decision based on their experience or intuition. However, 
often they decide that more business research is needed to generate additional information for a 
better understanding of the situation. 


Diagnosing and Assessing Problems or Opportunities 


After an organization recognizes a problem or identifies a potential opportunity, business research 
can help clarify the situation. Managers need to gain insight about the underlying factors causing 
the situation. If there is a problem, they need to specify what happened and why. If an opportunity 
exists, they may need to explore, refine, and quantity the opportunity. If multiple opportunities 
exist, research may be conducted to set priorities. 


Selecting and Implementing a Course of Action 


After the alternative courses of action have been clearly identified, business research is often con- 
ducted to obtain specific information that will aid in evaluating the alternatives and in selecting the 
best course of action. For example, suppose Harley-Davidson is considering establishing a dealer 
network in either China or India. In this case, business research can be designed to gather the relevant 
information necessary to determine which, if either, course of action is best for the organization. 
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evaluation research 


The formal, objective measure- 
ment and appraisal of the extent 
a given activity, project, or pro- 
gram has achieved its objectives 


performance-monitoring 
research 


Refers to research that regularly, 
sometimes routinely, provides 
feedback for evaluation and con- 
trol of business activity. 


Fun in the snow depends on 
weather trends, economic 
outlook, equipment, and 
clothing—all subjects for a 
business researcher. 


Part 1: Introduction 


Opportunities may be evaluated through the use of various performance criteria. For exam- 
ple, estimates of market potential allow managers to evaluate the revenue that will be gener- 
ated by each of the possible opportunities. A good forecast supplied by business researchers is 
among the most useful pieces of planning information a manager can have. Of course, complete 
accuracy in forecasting the future is not possible, because change is constantly occurring in the 
business environment. Nevertheless, objective information generated by business research to 
forecast environmental occurrences may be the foundation for selecting a particular course of 
action. 

Even the best plan is likely to fail if it is not properly implemented. Business research may be 
conducted to indicate the specific tactics required to implement a course of action. 


Evaluating the Course of Action 


After a course of action has been implemented, business research may serve as a tool to tell manag- 
ers whether or not planned activities were properly executed and if they accomplished what they 
were expected to accomplish. In other words, managers may use evaluation research to provide 
feedback for evaluation and control of strategies and tactics. 

Evaluation research is the formal, objective measurement and appraisal of the extent a given 
activity, project, or program has achieved its objectives. In addition to measuring the extent 
to which completed programs achieved their objectives or whether continuing programs are 
presently performing as projected, evaluation research may provide information about the major 
factors influencing the observed performance levels. 

In addition to business organizations, nonprofit organizations and governmental agencies 
frequently conduct evaluation research. Every year thousands of federal evaluation studies are 
undertaken to systematically assess the effects of public programs. For example, the General 
Accounting Office has been responsible for measuring outcomes of the Employment Oppor- 
tunity Act, the Job Corps program, and Occupational and Safety and Health Administration 
(OSHA) programs. 

Performance-monitoring research is a specific type of evaluation research that regularly, per- 
haps routinely, provides feedback for the evaluation and control of recurring business activity. 
For example, most firms continuously monitor wholesale and retail activity to ensure early detec- 
tion of sales declines and other anomalies. In the grocery and retail drug industries, sales research 
may use the Universal Product Code (UPC) for packages, together with computerized cash 
registers and electronic scanners at checkout counters, to provide valuable market-share informa- 
tion to store and brand managers 
interested in the retail sales vol- 
ume of specific products. 

United Airlines’ Omnibus 
in-flight survey provides a 
good example of performance- 
monitoring research for quality 
management. United routinely 
selects sample flights and admin- 
isters a questionnaire about in- 
flight service, food, and other 
aspects of air travel. The Omni- 
bus survey is conducted quar- 
terly to determine who is flying 
and for what reasons. It enables 
United to track demographic 
changes and to monitor cus- 
tomer ratings of its services on 
a continuing basis, allowing the 
airline to gather vast amounts 
2 of information at low cost. The 
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4A Harley-Davidson Goes Abroad 

Before Harley-Davidson goes overseas, 

it must perform considerable research 
on that market. It may find that consumers in 
some countries, such as France or Italy, have a 
strong preference for more economical and practical motor 
bikes. There, people may prefer a Vespa Wasp to a Harley Hog! 
Other times, they may find that consumers have a favorable atti- 
tude toward Harley-Davidson and that it could even be a product 
viewed as very prestigious. Harley recently considered doing 
business in India based on trend analysis showing a booming 
economy. Favorable consumer opinion and a booming economy 
were insufficient to justify distributing Harleys in India. The prob- 
lem? Luxury imports would be subject to very high duties which 
would make them cost-prohibitive to nearly all Indian consumers 
and India has strict emission rules for motor bikes. Thus, although 
research on the market was largely positive, Harley's research on 


information relating to customer reaction to services can be compared over time. For example, 
suppose United decided to change its menu for in-flight meals. The results of the Omnibus 


the political operating environment eventually determined its 
decision. Even after considerable negotiation, India refused to 
budge on tariffs although they were willing to give on emission 
standards. Instead, Harley may direct its effort more toward the 
U.S. women’s market for bikes. Research shows that motorcycle 
ownership among U.S. women has nearly doubled since 1990 to 
approximately 10 percent. Product research suggests that Harley 
may need to design smaller and sportier bikes to satisfy this mar- 
ket’s desires. Perhaps these new products would also be easier to 
market in India. Research will tell. 


Sources: “Harley Davidson Rules Out India Foray for Near Future,” Asia-Africa 
Intelligence Wire (September 2, 2005); “Women Kick It into Gear,” Akron Beacon 
Journal (May 22, 2005); “No Duty Cut 
on Harley Davidson Bikes, India to 
US,” The Financial Express (February 
24, 2008), www.financialexpress. 
com/news/No-duty-cut-on-Harley- 
Davidson-bikes-India-to-US/276635, 
accessed July 7, 2008. 
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survey might indicate that, shortly after the menu changed, the customers’ rating of the airline’s 


food declined. Such information about product quality would be extremely valuable, as it would 


allow management to quickly spot trends among passengers in other aspects of air travel, such 


as airport lounges, gate-line waits, or cabin cleanliness. Then managers could rapidly take action 


to remedy such problems. 


—Aristotle Onassis 


When Is Business Research Needed? 


The need to make intelligent, informed decisions ultimately motivates an organization to engage 


in business research. Not every decision requires research. Thus, when confronting a key decision, 


a manager must initially decide whether or not to conduct business research. The determination 


of the need for research centers on (1) time constraints, (2) the availability of data, (3) the nature of 


the decision to be made, and (4) the value of the research information in relation to costs. 


Time Constraints 


Systematic research takes time. In many instances, management believes that a decision must 


be made immediately, allowing no time for research. Decisions sometimes are made without 


adequate information or thorough understanding of the business situation. Although making deci- 


sions without researching a situation is not ideal, sometimes the urgency of a situation precludes 


the use of research. The urgency with which managers usually want to make decisions conflicts 


with researchers’ desire for rigor in following the scientific method. 


Availability of Data 


Often managers already possess enough data, or information, to make sound decisions without 


additional research. When they lack adequate information, however, research must be considered. 


This means that data need to be collected from an appropriate source. If a potential source of data 


exists, managers will want to know how much it will cost to get the data. 


Business Class Success? 
If you've ever checked the price of business-class airfare on a flight 
overseas, you were probably surprised at the price. A discounted 
round-trip coach ticket from Atlanta to Paris in peak season often 
costs just over one thousand dollars. That same business-class 
ticket would often cost between five and ten thousand-dollars! 
Typically, these flights take place in the larger passenger aircraft 
flown such as a Boeing 747 or a Boeing 777. A Boeing 777 can 
seat up to 450 passengers. However, by including three dozen 
business-class seats, the capacity drops to under 400 passengers. 
Thus, it is easy to see that a great deal of research must assess 
both the product design (what service and product attributes 
make up a business-class experience) and pricing (in both coach 
and business class) to determine the best configuration of the 
aircraft. Research shows that business-class travelers prioritize 
the comfort of the seat and the ability to be able to lie flat during 
the flight, the quality of food, and convenience of boarding as 
attributes that make up the business-class experience. 
In the past few years, a few start-up airlines have been try- 


little comfort for a reduction in price. They 
configured Boeing 737s (smaller than typical 
trans-ocean carriers) with 102 business- 
class seats that will not quite lie flaa—and 

no coach seats! The result is a business-class- 
only airline with cross-Atlantic fares ranging 
between $1,600 and $3,800, less than half of traditional business- 
class fares. Taking the concept to an even smaller scale, Eos con- 
figured Boeing 757s into 48-seat all-business-class planes. 

Both Maxjet and Eos received positive reviews, along with 
some criticisms. For example, Maxjet did not provide power 
outlets for laptops at their seats, considered by some to be a 
“fatal flaw” as far as business-class service is considered. Despite 
the apparent appeal, both Maxjet (December 2007) and Eos 
(April 2008) declared bankruptcy. 

Could more effective business research have determined 
these were not feasible business ventures? Or, could Maxjet’s 
“fatal flaw” of a lack of power outlets been identified? Sound 
business research may have enhanced the chance of success 


ing to capitalize on this of these airlines. 
concept by starting “dis- 
count” business-class-only 
airlines. Maxjet estimated that 


consumers will exchange a 


Sources: McCarnety, Scott, “Start-Up Airlines Fly Only Business Class,” The Wall 
Street Journal (September 20, 2005), D1; Pitock, Todd, “Getting There,” Forbes 176 
(September 2005), 30-32; Robertson, David, “Eos Bankruptcy Filing Signals End to 
Cheap Executive Travel,” The Times (April 28, 2008). 
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If the data cannot be obtained, or it cannot be obtained in a timely fashion, this particular 
research project should not be conducted. For example, many African nations have never con- 
ducted a population census. Organizations engaged in international business often find that data 
about business activity or population characteristics that are readily available in the United States 
are nonexistent or sparse in developing countries. Imagine the problems facing researchers who 
wish to investigate market potential in places like Uzbekistan, Macedonia, or Rwanda. 


Nature of the Decision 


The value of business research will depend on the nature of the managerial decision to be made. A 
routine tactical decision that does not require a substantial investment may not seem to warrant a 
substantial expenditure for research. For example, a computer company must update its operator’s 
instruction manual when it makes minor product modifications. The research cost of determining 
the proper wording to use in the updated manual is likely to be too high for such a minor deci- 
sion. The nature of the decision is not totally independent of the next issue to be considered: the 
benefits versus the costs of the research. In general, however, the more strategically or tactically 
important the decision, the more likely it is that research will be conducted. 


Benefits versus Costs 


Earlier we discussed some of the managerial benefits of business research. Of course, conduct- 
ing research to obtain these benefits requires an expenditure of money. In any decision-making 
situation, managers must identify alternative courses of action and then weigh the value of each 
alternative against its cost. Business research can be thought of as an investment alternative. When 
deciding whether to make a decision without research or to postpone the decision in order to 
conduct research, managers should ask three questions: 


1. Will the payoff or rate of return be worth the investment? 
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2. Will the information gained by business research improve the quality of the managerial deci- 
sion enough to warrant the expenditure? 
3. Is the proposed research expenditure the best use of the available funds? 


For example, TV-Cable Week was not test-marketed before its launch. Although the magazine 
had articles and stories about television personalities and events, its main feature was program listings, 
channel by channel, showing the exact programs a particular subscriber could receive. To produce a 
custom magazine for each individual cable television system in the country required developing a costly 
computer system. Because that development necessitated a substantial expenditure, one that could not 
be scaled down by research, conducting research was judged to be an unwise investment. The value of 
the potential research information was not positive because its cost exceeded its benefits. Unfortunately, 
pricing and distribution problems became so compelling after the magazine was launched that the prod- 
uct was a failure. Nevertheless, without the luxury of hindsight, managers made a reasonable decision not 
to conduct research. They analyzed the cost of the information relative to the potential benefits of the 
information. Exhibit 1.3 outlines the criteria for determining when to conduct business research. 


=XHIBIT 1.3 Determining When to Conduct Business Research 


Availability Nature of the Benefits versus 
Time Constraints of Data Decision Costs 
Is sufficient time Is it feasible Is the decision Does the value of the 
i ; : 5 Í Conduct 
available before a to obtain of considerable research information Busines: 
decision will be made? Yes the data? Yes strategic or tactical Yes exceed the cost of Yes ne 
== = importance? — >} conducting research? = 


con eh al el 


Do Not Conduct Business Research 


Business Research in the Twenty-First Century 


Business research, like all business activity, continues to change. Changes in communication tech- 
nologies and the trend toward an ever more global marketplace have played a large role in many 
of these changes. 


Communication Technologies 


Virtually everyone is “connected” today. Increasingly, many people are “connected” nearly all 
the time. Within the lifetime of the typical undergraduate college senior, the way information is 
exchanged, stored, and gathered has been revolutionized completely. Today, the amount of infor- 
mation formally contained in an entire library can rest easily in a single personal computer. 

The speed with which information can be exchanged has also increased tremendously. Dur- 
ing the 1970s, exchanging information overnight through a courier service from anywhere in 
the continental United States was heralded as a near miracle of modern technology. Today, we 
can exchange information from nearly anywhere in the world to nearly anywhere in the world 
almost instantly. Internet connections are now wireless, so one doesn’t have to be tethered to 
a wall to access the World Wide Web. Our mobile phones and handheld data devices can be 
used not only to converse, but also as a means of communication that can even involve busi- 
ness research data. In many cases, technology also has made it possible to store or collect data 
for lower costs than in the past. Electronic communications are usually less costly than regular 
mail—and certainly less costly than a face-to-face interview—and cost about the same amount 
no matter how far away a respondent is from a researcher. Thus, the expressions “time is col- 
lapsing” and “distance is disappearing” capture the tremendous revolution in the speed and 
reach of our communication technologies. 
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“Jacques” Daniels drinks or other mixers. As a result of this 


Sales of U.S. distilled spirits have declined over the last 10 to research, JD launched a mixture called 

15 years as more Americans turn to wine or beer as their bever- “Jack and Cola” sold in 12-ounce bottles 

age of choice. As a result, companies like Bacardi and Brown- all around Australia. The product has 

Forman, producers of Jack Daniels, have pursued business been very successful. 

development strategies involving increased efforts to expand 3. British distilled spirit consumers also 

into international markets. The Brown-Forman budget for inter- like mixed drinks, but they usually partake in bars and 
national ventures includes a significant allocation for research. By restaurants. 

doing research before launching the product, Brown-Forman can 4. In China and India, consumers more often chose counterfeit 
learn product usage patterns within a particular culture. Some of or “knock-offs” to save money. Thus, innovative research 

the findings from this research indicate approaches have addressed questions related to the way the 


black market works and how they can better educate con- 
sumers about the differences between the real thing and the 
knock-offs. 


1. Japanese consumers use Jack Daniels (JD) as a dinner bever- 
age. A party of four or five consumers in a restaurant will 
order and drink a bottle of JD with their meal. 

2. Australian consumers The result is that Jack Daniels is now sold extensively, in various 
mostly consume distilled forms, and with different promotional campaigns, outside of the 
spirits in their homes. Also United States. 
in contrast to Japanese Sources: Swibel, Mathew, “How Distiller Brown-Forman Gets Rich by Exploiting 
consumers, Australians the Greenback’s Fall—and Pushing Its Brands Abroad,” Forbes 175, no. 8 (2005), 
prefer to mix JD with soft 152-155. 


Changes in computer technology have made for easier data collection and data analysis. As we dis- 
cuss in a later chapter, many consumer household panels now exist and can be accessed via the Inter- 
net. Thus, there is less need for the time and expense associated with regular mail survey approaches. 
Furthermore, the computing power necessary to solve complicated statistical problems is now easily 
accessible. Again, as recently as the 1970s, such computer applications required expensive mainframe 
computers found only in very large corporations, major universities, and large governmental/military 
institutions. Researchers could expect to wait hours or even longer to get results from a statistical pro- 
gram involving 200 respondents. Today, even the most basic laptop computers can solve complicated 
statistical problems involving thousands of data points in practically a nanosecond. 


Global Business Research 


Like all business activities, business research has become increasingly global as more and more 
firms operate with few, if any, geographic boundaries. Some companies have extensive inter- 
national research operations. Upjohn conducts research in 160 different countries. ACNielsen 
International, known for its television ratings, is the world’s largest research company. Two-thirds 
of its business comes from outside the United States." Starbucks can now be found in nearly every 
developed country on the earth. AFLAC offers its products on multiple continents. DuPont has a 
significant presence in all regions of the world. 

Companies that conduct business in foreign countries must understand the nature of those 
particular markets and judge whether they require customized business strategies. For example, 
although the fifteen nations of the European Union share a single formal market, research shows 
that Europeans do not share identical tastes for many consumer products. Business researchers 
have found no such thing as a “typical” European consumer; language, religion, climate, and cen- 
turies of tradition divide the nations of the European Union. Scantel Research, a British firm that 
advises companies on color preferences, found inexplicable differences in Europeans’ preferences 
in medicines. The French prefer to pop purple pills, but the English and Dutch favor white ones. 
Consumers in all three countries dislike bright red capsules, which are big sellers in the United 
States. This example illustrates that companies that do business in Europe must research through- 
out Europe to adapt to local customs and buying habits." 

Even companies that produce brands that are icons in their own country are now doing 
research internationally. The Research Snapshot above discusses how Brown-Forman, the parent 
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company of Jack Daniels (the classic American “sour mash” or Bourbon whiskey), is now inter- 
viewing consumers in the far corners of the world.'* The internationalization of research places 
greater demands on business researchers and heightens the need for research tools that allow us 
to cross-validate research results, meaning that the empirical findings from one culture also exist 
and behave similarly in another culture. The development and application of these international 
research tools are an important topic in basic business research." 


Overview 


The business research process is often presented as a linear, sequential process, with one specific step 
following another. In reality, this is not the case. For example, the time spent on each step varies, 
overlap between steps is common, some stages may be omitted, occasionally we need to backtrack, 
and the order sometimes changes. Nonetheless, some structure for the research process is necessary. 

The book is organized to provide this structure, both within each chapter and in the order of the 
chapters. Each chapter begins with a set of specific learning objectives. Each chapter then opens with a 
Chapter Vignette—a glimpse of a business research situation that provides a basis of reference for that 
chapter. Each chapter also contains multiple Research Snapshots—specific business research scenarios 
that illustrate key points. Finally, each chapter concludes with a review of the learning objectives. 

The book is organized into seven parts. Part 1 is the Introduction, which includes this chapter 
and four others. This chapter provided an introduction to business research. The next three chap- 
ters of the book give students a fuller understanding of the business research environment. Part 2, 
Beginning Stages of the Research Process, provides the foundation for business research, discuss- 
ing problem definition and qualitative and secondary research. The third section of the book, 
Research Designs for Collecting Primary Data, introduces survey research, discusses observation as 
a research technique, and provides an overview of experimental research. Measurement Concepts, 
Part 4 of the book, discusses the measurement of research constructs and questionnaire design. Part 
5, Sampling and Fieldwork, describes the process involved in selecting a research sample and col- 
lecting data. Part 6, Data Analysis and Presentation, explains the various approaches to analyzing 
the data and describes methods of presentation. The book concludes with Part 7, Comprehen- 
sive Cases with Computerized Databases, which will be integrated throughout the first six parts. 
Exhibit 1.4 provides an overview of the book and the research process. 


Sharing the Results 
Analyzing the Data 
Collecting the Data 
Determining the Sample 
Designing the Data Collection Instrument 


Understanding Measurement of Research Constructs 


Research Techniques: Observation and Experimentation Al 


Problem Definition, Secondary and Qualitative Research 9 


Chapters 5, 6, & 7 


Understanding Business Research 
Chapters 1, 2, 3, & 4 
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cross-validate 


To verify that the empirical 
findings from one culture also 
exist and behave similarly in 
another culture. 


EXHIBIT 1.4 
An Overview of Business 
Research 


A 
m 


Sf 
e Be sure to fully understand the differing roles of exploratory, takes the form of experiments such S 

descriptive, and causal research. as test markets. 
e Exploratory research provides new insights—the domain e A major flaw in business research is to not 

of discovery in philosophy of science terms—and often give due diligence to exploratory research 

sets the groundwork for further investigation. (especially secondary data and qualitative 
e Descriptive research describes the characteristics of research). Instead, researchers often move too 

objects, people, or organizations. Much of business infor- quickly to collecting descriptive data. 

mation is based on descriptive research. e A second, and related, flaw in business research is to fail to 
e Causal research is the only research that establishes cause carefully define the research objectives. 
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and effect relationships. Most commonly, causal research 


Summary 


There were six learning objectives in this chapter. After reading the chapter, the student should 
be competent in each area described by a learning objective. 


1. Understand how research contributes to business success. While many business decisions are 
made “by the seat of the pants” or based on a manager’s intuition, this type of decision making 
carries with it a large amount of risk. By first researching an issue and gathering the appropriate 
information (from employees, customers, competitors, and the market) managers can make a 
more informed decision. The result is less risky decision making. 

Research is the intelligence-gathering function in business. The intelligence includes infor- 
mation about customers, competitors, economic trends, employees, and other factors that affect 
business success. This intelligence assists in decisions ranging from long-range planning to near- 
term tactical decisions. 


2. Know how to define business research. Business research is the application of the scientific 
method in searching for truth about business phenomena. The research must be conducted sys- 
tematically, not haphazardly. It must be objective to avoid the distorting effects of personal bias. 
Business research should be rigorous, but the rigor is always traded off against the resource and 
time constraints that go with a particular business decision. 


3. Understand the difference between basic and applied business research. Applied business 
research seeks to facilitate managerial decision making. It is directed toward a specific managerial 
decision in a particular organization. Basic or pure research seeks to increase knowledge of theo- 
ries and concepts. Both are important, but applied research is more often the topic in this text. 


4. Understand how research activities can be used to address business decisions. Businesses can 
make more accurate decisions about dealing with problems and/or the opportunities to pursue 
and how to best pursue them. The chapter provides examples of studies involving several dimen- 
sions of managerial decision making. Thus, business research is useful both in a strategic and in 
a tactical sense. 


5. Know when business research should and should not be conducted. Managers determine 
whether research should be conducted based on (1) time constraints, (2) availability of data, 
(3) the nature of the decision to be made, and (4) the benefit of the research information versus 
its cost. 


6. Appreciate the way that technology and internationalization are changing business 
research. Technology has changed almost every aspect of business research. Modern computer 
and communications technology makes data collection, study design, data analysis, data reporting, 
and practically all other aspects of research easier and better. Furthermore, as more companies 
do business outside their own borders, companies are conducting research globally. This places 
a greater emphasis on research that can assess the degree to which research tools can be applied 
and interpreted the same way in different cultures. Thus, research techniques often must cross- 
validate results. 
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Key Terms and Concepts 
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applied business research, 6 evaluation research, 10 production-oriented, 8 
basic business research, 7 marketing-oriented, 8 the scientific method, 7 
business research, 5 performance-monitoring research, 10 

cross-validate, 15 product-oriented, 8 


Questions for Review and Critical Thinking 


1. Is it possible to make sound managerial decisions without busi- 
ness research? What advantages does research offer to the deci- 
sion maker over seat-of-the-pants decision making? 

2. Define a marketing orientation and a product orientation. 
Under which strategic orientation is there a greater need for 
business research? 

3. Name some products that logically might have been developed 
with the help of business research. 

4. Define business research and describe its task. 

5. Which of the following organizations are likely to use business 
research? Why? How? 

Manufacturer of breakfast cereals 

Manufacturer of nuts, bolts, and other fasteners 

The Federal Trade Commission 

A hospital 

. A company that publishes business textbooks 


oRooe 


6. An automobile manufacturer is conducting research in an 
attempt to predict the type of car design consumers will desire 
in the year 2020. Is this basic or applied research? Explain. 


Research Activities 


1. ‘NET Suppose you owned a jewelry store in Denton, Texas. 
You are considering opening a second store just like your cur- 
rent store. You are undecided on whether to locate the new 
store in another location in Denton, Texas, or in Birmingham, 
Alabama. Why would you decide to have some research done 
before making the decision? Should the research be conducted? 
Go to http://www.census.gov. Do you think any of this informa- 
tion would be useful in the research? 


T; 


10. 


11. 


Comment on the following statements: 

a. Managers are paid to take chances with decisions. 
Researchers are paid to reduce the risk of making those 
decisions. 

b. A business strategy can be no better than the information 
on which it is formulated. 

c. The purpose of research is to solve business problems. 

List the conditions that help a researcher decide when research 

should or should not be conducted. 

How have technology and internationalization affected business 

research? 

‘NET How do you believe the Internet has facilitated research? 

Try to use the Internet to find the total annual sales for 

Starbucks, for AFLAC, and for DuPont. 

What types of tools does the researcher use more given the ever 

increasing internationalization of business? 


‘NET Find recent examples of news articles involving the use of 
business research in making decisions about different aspects of 
business. 

‘NET Find an article illustrating an example of an applied 
research study involving some aspect of technology. How does 
it differ from a basic research study also focusing on a similar 
aspect of technology? 


CHAPTER 2 
INFORMATION 
SYSTEMS AND 
KNOWLEDGE 
MANAG EM E NT After studying this chapter, you should be able to 


1. Know and distinguish the concepts of data, information, 
and intelligence 


2. Understand the four characteristics that describe data 


3. Know the purpose of research in assisting business 
operations 


4. Know what a decision support system is and does 
5. Recognize the major categories of databases 


Chapter Vignette: Data for Doughnuts! 


Who makes the best doughnut in America? Which doughnut firm has the best business plan? 

These are two different questions to some extent. There is more to selling doughnuts than mak- 

ing a great doughnut. 

Krispy Kreme is the market-share leader among U.S. doughnut firms, operating 

hundreds of stores in practically every state in the nation; 

it also has operations in 15 

foreign countries, with stores 
scheduled to open soon in 
China! 

Although consumers may 
first think of the neon-laced 
doughnut shops when they 

think of Krispy Kreme, the 

fact is that the bulk of Krispy 

Kreme’s revenue is generated 

from doughnut sales outside 

of its own stores. Krispy Kremes 

can be found in thousands of 

convenience and grocery stores 

and at practically every super store 

in the United States. Thus, there is 

a great deal of data to keep track 

of in terms of where doughnuts 

are delivered and where they are 

sold. Collecting these data manually 

would involve thousands of phone 

calls each time the data were needed. 
Clearly, this would be a labor intensive 
process, particularly considering that 

the decisions made based on these data include many day-to-day operational decisions. 

While Krispy Kreme could develop systems and hardware that could track all of these data in 
real time, it opted to outsource this effort to a company that specializes in tracking, recording, 
and storing retail sales data. For Krispy Kreme, this proves more cost effective than purchasing 
and maintaining the technology to complete this task themselves. The data feed into software 
systems known as decision support systems, which allow Krispy Kreme to adjust production 
schedules to meet demand, adjust pricing, manage billing processes, and even track inventory- 
shrinkage trends. Thus, if a store’s employees or customers are indulging in the Krispy Kremes 
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without purchasing them, the system lets the executives at Krispy Kreme know. Furthermore, when 
Krispy Kreme needs specific data, the information provider may very well already have the data avail- 
able in a data warehouse. Thus, the data provide knowledge that greatly assists Krispy Kreme business 
managers in day-to-day operational matters.' 
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Introduction 


Krispy Kreme’s use of an outside firm to manage its information illustrates the sometimes sophis- 
ticated way in which modern businesses integrate data into their decision processes. Many of the 
decisions that used to be made with guesswork are now supplemented with “intelligence” either 
automatically delivered by some computer software or drawn from a data warehouse. 

Doughnut companies certainly aren’t alone in this effort. Imagine all the information that 
passes through a single Home Depot store each day. Every customer transaction, every empty 
shelf, every employee’s work schedule—right down to the schedule to clean restrooms—creates 
potentially valuable information that can be used by researchers and decision makers. Considering 
that Home Depot operates thousands of stores, obviously, Home Depot needs a data depot! 

Like Krispy Kreme, Home Depot has outsourced the storage and management of data inven- 
tories. In this case, IBM manages the data, allowing it to be integrated into management strategy 
and tactics. Data from cash registers, time clocks, shelf counts, and much more are all compiled, 
analyzed, and either fed automatically into management systems or supplied in the form of a 
research report. In a way, this type of business research is automatic!* 

This chapter discusses knowledge management and the role decision support systems play in 
helping firms make informed business decisions. The chapter also introduces the concept of global 
information systems and sources of data that exist beyond the walls of any business. Modern data 
technology allows businesses to more easily integrate research into strategy and operations. 


Information, Data, and Intelligence 


In everyday language, terms like information and data are often used interchangeably. Researchers use 
these terms in specific ways that emphasize how useful each can be. Data are simply facts or recorded 
measures of certain phenomena (things or events). Information is data formatted (structured) to sup- 
port decision making or define the relationship between two facts. Business intelligence is the subset 
of data and information that actually has some explanatory power enabling effective managerial deci- 
sions to be made. So, there is more data than information, and more information than intelligence. 

Think again about the thousands upon thousands of unsummarized facts recorded by Home 
Depot each day. Each time a product is scanned at checkout, that fact is recorded and becomes data. 
Each customer’s transactions are simultaneously entered into the store’s computerized inventory 
system. The inventory system structures the data in such a way that a stocking report can be gener- 
ated and orders for that store can be placed. Thus, the automated inventory system turns data into 
information. Further, the information from each store’s sales and inventory records may be har- 
vested by analysts. The analysts may analyze the trends and prepare reports that help Home Depot 
buyers get the right products into each store or to even suggest places for new Home Depot loca- 
tions. Thus, the analyst has now completed the transformation of data into intelligence. Exhibit 2.1 
on the next page helps to illustrate the distinction between data, information, and intelligence. 


The Characteristics of Valuable Information 


Not all data are valuable to decision makers. Useful data become information and help a business 
manager make decisions. Useful data can also become intelligence. Four characteristics help deter- 
mine how useful data may be: relevance, quality, timeliness, and completeness. 


data 


Facts or recorded measures of 
certain phenomena (things). 


information 


Data formatted (structured) to 
support decision making or 
define the relationship between 
two facts. 


business intelligence 


The subset of data and infor- 
mation that actually has some 
explanatory power enabling 
effective decisions to be made. 


COURTESY OF QUALTRICS.COM 


Worthwhile 


EXHIBIT 2.1 
Data, Information, 
Intelligence 
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Go back and review the question- 

naire that you responded to last 

chapter. Later, you'll be asked to ana- 

lyze data with the hope of predict- 

ing and explaining some important 

outcomes with business implications. 

Now, which sections do you think would provide 
the most value to a head-hunting firm that matches 
employers to potential employees. What kinds of 
information will this section of the survey yield and 
how might it help the head-hunting firm? 


e Products purchased are 
recorded by the scanner 
forming data. 


e Inventory systems use 
the data to create 
information. 


e The information tells 
managers what items 
need to be stocked. 

e The information also 
generates and can even 
place orders for more 
products to be trucked 
to the store. 


e Analysts analyze the data 
statistically and write 
research reports 
addressing important 
questions such as 


o What types of trends 
exist in customer 
purchases, and are 
there regional 
differences? 


o Where should new 
stores be located? 
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Relevance 


Relevance is the characteristics of data reflecting how pertinent these particular facts are to the situ- 
ation at hand. Put another way, the facts are logically connected to the situation. Unfortunately, 
irrelevant data and information often creep into decision making. One particularly useful way to 
distinguish relevance from irrelevance is to think about how things change. Relevant data are facts 
about things that can be changed, and if they are changed, it will materially alter the situation. So, 
this simple question becomes important: 


Will a change in the data coincide with a change in some important outcome? 


American consumers’ dietary trends are relevant to Krispy Kreme. If American diets become 
more health-conscious, then the sales of doughnuts can be affected. This may lead Krispy Kreme 
to rethink its product offering. However, information on French consumers’ wine preferences is 
probably irrelevant since it is difficult to think how a change in French wine preferences will affect 
U.S. doughnut preferences. 


Quality 


Data quality is the degree to which data represent the true situation. High-quality data are accu- 
rate, valid, and reliable, issues we discuss in detail in later chapters. High-quality data represent 
reality faithfully. If a consumer were to replace the product UPC from one drill at Home Depot 
with one from a different drill, not only would the consumer be acting unethically, but it would 
also mean that the data collected at the checkout counter would be inaccurate. Therefore, to the 
extent that the cash register is not actually recording the products that consumers take out of the 
stores, its quality is lowered. Sometimes, researchers will try to obtain the same data from multiple 
data sources as one check on its quality.’ Data quality is a critical issue in business research, and it 
will be discussed throughout this text. 


Timeliness 


Business is a dynamic field in which out-of-date information can lead to poor decisions. Busi- 
ness information must be timely—that is, provided at the right time. Computerized information 
systems can record events and dispense relevant information soon after the event. A great deal of 
business information becomes available almost at the moment that a transaction occurs. Timeliness 
means that the data are current enough to still be relevant. 

Computer technology has redefined standards for timely information. For example, if a busi- 
ness executive at Home Depot wishes to know the sales volume of any store worldwide, detailed 
information about any of thousands of products can be instantly determined. At Home Depot, the 
point-of-sale checkout system uses UPC scanners and satellite communications to link individual 
stores to the headquarters’ computer system, from which managers can retrieve and analyze up-to- 
the-minute sales data on all merchandise in each store. 


Completeness 


Information completeness refers to having the right amount of information. Managers must have 
sufficient information about all aspects of their decisions. For example, a company considering 
establishing a production facility in Eastern Europe may plan to analyze four former Soviet-bloc 
countries. Population statistics, GDP, and information on inflation rates may be available on all 
four countries. However, information about unemployment levels may be available for only three 
of the countries. If information about unemployment or other characteristics cannot be obtained, 
the information is incomplete. Often incomplete information leads decision makers to conduct 
their own business research. 
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relevance 


The characteristics of data 
reflecting how pertinent these 
particular facts are to the 
situation at hand. 


data quality 


The degree to which data repre- 
sent the true situation. 


timeliness 


Means that the data are current 
enough to still be relevant. 


information completeness 


Having the right amount of 
information. 


COURTESY OF DIVISION OF PUBLIC 
SERVICE, USMC, DEPT. OF DEFENSE, USA 


RFID Technology Gets Cheaper—Business 
Knowledge Grows 
Radio frequency identification (RFID) tags have been used by large 
organizations for several years now. The U.S. military makes great 
use of RFIDs in tracking the whereabouts of virtually all kinds of 
products both big and small. Logistics officers can instantly track 
the whereabouts of Humvees and MREs (Meals Ready to Eat). 
Information from the tag is transmitted to computer servers and 
then directly into a GTN (Global Tracking Network). Equipment and 
supplies can then be ordered and dispatched to needed locations 
with a minimal of human contact. Product consumption (ammu- 
nition, food, water, computer printers, and so forth) can also be 
tracked in real time. The Marines can know in real time if person- 
nel in a desert use more food 
and water than personnel ina 
jungle. 

Wal-Mart is pushing sup- 
pliers to adopt the technology. 


Not only can Wal-Mart use them in logistical 
operations, but the potential exists to “go 
into” consumers’ homes and track how 
much and the way consumers actually con- 
sume products. Potentially, decision support 
systems (DSS) could tie ordering to customer 
consumption. However, the costs of RFIDs make it impractical for 
many suppliers. 

Alien Technology Corporation recently announced a drop in 
the price of RFID tags. Now, when a company orders a million or 
more, the unit cost for an RFID is 12.9¢. Although this is a “basic” 
RFID tag, it still can store 96 bits of information. Analysts predict 
that the price of RFID tags will continue to drop. By 2008, the 
cost may drop to about 5¢, at which point the use of RFID tech- 
nology in business research and operations should soar. 

Sources: Clark, Don, “Alien Cuts Radio ID Tag Price to Spur Adoption by Retailers,” 


The Wall Street Journal (September 12, 2005), D4; Fergueson, R. B., “Marines Deploy 
RFID,” e-Week 21 (November 15, 2004), 37. 


© GEORGE DOYLE & CIARAN GRIFFIN 


Knowledge Management 


Who has the best pizza in town? The answer to this question requires knowledge. Indeed, you, 


as a consumer, have stored knowledge about many products. You know the best restaurants, best 


theaters, best bars, and so forth. All of this knowledge helps you make decisions as a consumer. 


Much of it is based on personal research involving product trials or searches for information. From 


an individual’s perspective, knowledge is simply what you have stored in memory. It helps you 


make decisions about a variety of things in your life. 
Organizations can use knowledge in a similar way. Knowledge is accumulated not just from a 


single individual, however, but from many sources. Financial managers, human resource manag- 


ers, sales managers, customer reports, economic forecasts, and custom-ordered research all con- 


tribute to an organization’s knowledge base. All of this data forms the organization’s memory. 


knowledge 


A blend of previous experience, 
insight, and data that forms orga- 
nizational memory. 

tial competitive advantage.* 

knowledge management 


The process of creating an inclu- 
sive, comprehensive, easily acces- 
sible organizational memory, 
which is often called the organi- 
zation’s intellectual capital. 


From a company’s perspective, knowledge is a blend of previous experience, insight, and data that 
forms organizational memory. It provides a framework that can be thoughtfully applied when 
assessing a business problem. Business researchers and decision makers use this knowledge to help 
create solutions to strategic and tactical problems. Thus, knowledge is a key resource and a poten- 


Knowledge management is the process of creating an inclusive, comprehensive, easily accessi- 
ble organizational memory, which can be called the organization’s intellectual capital.” The purpose 
of knowledge management is to organize the intellectual capital of an organization in a formally 
structured way for easy use. Knowledge is presented in a way that helps managers comprehend 
and act on that information and make better decisions in all areas of business. Knowledge man- 
agement systems are particularly useful in making data available across the functional areas of the 


firm. Thus, marketing, management, and financial knowledge can be integrated. Recent research 


demonstrates how knowledge management systems are particularly useful in new product devel- 


opment and introduction.® 


The firm’s sales force plays a particularly useful role in the knowledge management process. 


Salespeople are in a key position to have a lot of knowledge about customers and the firm’s 


capabilities. Thus, they are tools both for accumulating knowledge and for turning it into useful 


information.’ Market-oriented organizations generally provide both formal and informal methods 


through which the knowledge gained by salespeople can be entered into a data warehouse to assist 


all decision makers, not just the sales force. 
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Global Information Systems 


Increased global competition and technological advances in interactive media have given rise to 
global information systems. A global information system is an organized collection of computer 
hardware, software, data, and personnel designed to capture, store, update, manipulate, analyze, 
and immediately display information about worldwide business activities. A global information 
system is a tool for providing past, present, and projected information on internal operations and 
external activity. Using satellite communications, high-speed microcomputers, electronic data 
interchanges, fiber optics, data storage devices, and other technological advances in interactive 
media, global information systems are changing the nature of business. 

Consider a simple example. At any moment, United Parcel Service (UPS) can track the status 
of any shipment around the world. UPS drivers use handheld electronic clipboards called delivery 
information acquisition devices (DIADs) to record appropriate data about each pickup or delivery. 
The data are then entered into the company’s main computer for record-keeping and analysis. A 
satellite telecommunications system allows UPS to track any shipment for a customer. 

RFID stands for radio frequency identification. It is a new technology that places a tiny chip, 
which can be woven onto a fabric, onto virtually any product, allowing it to be tracked anywhere 
in the world. This can provide great insight into the different distribution channels around the 
world and, potentially, to the different ways consumers acquire and use products. The U.S. mili- 
tary uses RFID technology to assist in its logistics, and Wal-Mart is one of the leading proponents 
of the technology as it can greatly assist in its global information system." 

With so much diverse information available in a global information system, organizations 
have found it necessary to determine what data, information, and knowledge are most useful to 
particular business units. 


Decision Support Systems 


Business research can be described in many ways. One way is to categorize research based on the 
four possible functions it serves in business: 


1. Foundational—answers basic questions. What business should we be in? 

2. Testing—addresses things like new product concepts or promotional ideas. How effective will 
they be? 

3. Issues—examines how specific issues impact the firm. How does organizational structure 
impact employee job satisfaction and turnover? 

4. Performance—monitors specific metrics including financial statistics like profitability and 
delivery times. They are critical in real-time management and in “what-if” types of analyses 
examining the potential impact of a change in policy. 


Of these, it is the performance category that is of most interest to decision support systems. The 
metrics that are monitored can be fed into automated decision-making systems, or they can trigger 
reports that are delivered to managers. These form the basis of a decision support system and best 
typify the way business research assists managers with day-to-day operational decisions. 

A decision support system (DSS) is a system that helps decision makers confront problems 
through direct interaction with computerized databases and analytical software programs. The 
purpose of a decision support system is to store data and transform them into organized informa- 
tion that is easily accessible to managers. Doing so saves managers countless hours so that decisions 
that might take days or even weeks otherwise can be made in minutes using a DSS. 

Modern decision support systems greatly facilitate customer relationship management (CRM). 
A CRM system is the part of the DSS that addresses exchanges between the firm and its custom- 
ers. It brings together information about customers including sales data, market trends, marketing 
promotions and the way consumers respond to them, customer preferences, and more. A CRM 
system describes customer relationships in sufficient detail so that financial directors, marketing 
managers, salespeople, customer service representatives, and perhaps the customers themselves can 
access information directly, match customer needs with satisfying product offerings, remind cus- 
tomers of service requirements, and know what other products a customer has purchased. 
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global information system 


An organized collection of com- 
puter hardware, software, data, 
and personnel designed to cap- 
ture, store, update, manipulate, 
analyze, and immediately display 
information about worldwide 
business activity. 


decision support system 
(DSS) 


A computer-based system that 
helps decision makers confront 
problems through direct interac- 
tion with databases and analyti- 
cal software programs. 


customer relationship 
management (CRM) 


Part of the DSS that addresses 
exchanges between the firm and 
its customers. 
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Are Businesses Clairvoyant? 
A business traveler checks into a Wyndham hotel and finds 
his favorite type of pillow, favorite snacks, and a one of his 
favorite types of wine waiting upon arrival. Another customer 
daydreams of a recent golf vacation to Hawaii and wishes she 
could do it again. Later that day, an e-mail from Travelocity 
arrives with a great package deal to visit the same resort. Yet 
another consumer visits Barnesandnoble.com and a pop-up 


Decision Support System 


database 


results that allow them to predict con- 
sumer preferences and even cyclical usage 
patterns quite accurately. Modern technol- 
ogy gives these firms a big advantage in 
the marketplace. Firms that don’t adapt 
the technology may have a much harder time 

serving their customers. The latest technologies even provide 
ways for customers to voluntarily enter data or block certain 
data from being transmitted to the companies they do busi- 
ness with. 


displays a new novel by 

his favorite author. Using 

a system called active data 
warehousing, the companies 
integrate data with research 


Sources: Schwarz, E., “Data Warehouses Get Active,” Infoworld (December 8, 2003), 
12; Watson, Richard T., “| Am My Own Database,” Harvard Business Review 82 
(November 2004), 18-19. 


Casinos track regular customers’ behavior via “players’ cards” that are swiped each time a 
consumer conducts a transaction. This information is fed automatically into a CRM system that 
creates tailor-made promotional packages. The promotion may be unique to a specific customer’s 
preferences as tracked by their own pattern of behavior. You may notice when visiting certain 
Web sites that they seem to be able to predict your behavior. The Research Snapshot above titled 
“Are Businesses Clairvoyant?” tells how a CRM may be behind this clairvoyance. 

Exhibit 2.2 provides a basic illustration of a decision support system. Raw, unsummarized data 
are input to the DSS. Data collected in business research projects are a major source of this input, 
but the data may be purchased or collected by accountants, financial officers, sales managers, produc- 
tion managers, or company employees other than business researchers. Effective businesses spend a 
great deal of time and effort collecting information for input into the decision support system. Useful 
information is the output of a DSS. A decision support system requires both databases and software. 
For firms operating across national borders, the DSS becomes part of its global information system. 


Decision Support System 


Input > > Output 


A collection of raw data arranged 
logically and organized in a form 

that can be stored and processed 
by a computer. 


data warehousing 


The process allowing important 
day-to-day operational data 

to be stored and organized for 
simplified access. 


data warehouse 


The multitiered computer store- 
house of current and historical data. 
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Databases and Data Warehousing 


A database is a collection of raw data arranged logically and organized in a form that can be stored 
and processed by a computer. A customer mailing list is one type of database. Population char- 
acteristics may be recorded by state, county, and city in another database. Production figures and 
costs can come from internal company records. Modern computer technology makes both the 
storage and retrieval of this information easy and convenient. Twenty years ago, the population 
data needed to do a retail site analysis may have required days, possibly weeks, in a library. Today, 
the information is just a few clicks away. 

Data warehousing is the process allowing important day-to-day operational data to be stored 
and organized for simplified access. More specifically, a data warehouse is the multitiered computer 
storehouse of current and historical data. Data warehouse management requires that the detailed 
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data from operational systems be extracted, transformed, placed into logical partitions (for example, 
daily data, weekly data, etc.), and stored in a consistent manner. Organizations with data warehouses 
may integrate databases from both inside and outside the company. Managing a data warehouse 
effectively requires considerable computing power and expertise. As a result, data warehouse com- 
panies exist that provide this service for companies in return for a fee.” Data warehousing allows 
for sophisticated analysis, such as data mining, discussed more in Chapter 8. 


Input Management 


How does data end up in a data warehouse where it can be used by a decision support system? In 
other words, how is the input managed? Input includes all the numerical, text, voice, and image 
data that enter the DSS. Systematic accumulation of pertinent, timely, and accurate data is essential 
to the success of a decision support system. 

DSS managers, systems analysts, and programmers are responsible for the decision support sys- 
tem as a whole, but many functions within an organization provide input data. Business research- 
ers, accountants, corporate librarians, personnel directors, salespeople, production managers, and 
many others within the organization help to collect data and provide input for the DSS. Input data 
can also come from external sources. 

Exhibit 2.3 on the next page shows five major sources of data input: internal records, propri- 
etary business research, salesperson input, behavioral tracking, and outside vendors and external 
distributors of data. Each source can provide valuable input. 


INTERNAL RECORDS 


Internal records, such as accounting reports of production costs and sales figures, provide consid- 
erable data that may become useful information for managers. An effective data collection system 
establishes orderly procedures to ensure that data about costs, shipments, inventory, sales, and 
other aspects of regular operations are routinely collected and entered into the computer. 


PROPRIETARY BUSINESS RESEARCH 


Business research has already been defined as a broad set of procedures and methods. To clarify 
the DSS concept, consider a narrower view of business research. Proprietary business research 
emphasizes the company’s gathering of new data. Few proprietary research procedures and meth- 
ods are conducted regularly or continuously. Instead, research projects conducted to study specific 
company problems generate data; this is proprietary business research. Providing managers with 
nonroutine data that otherwise would not be available is a major function of proprietary business 
research. Earlier, we discussed four categories of research. Proprietary research often involves 
either the testing and/or issues types of research. 


SALESPERSON INPUT 


Salespeople are typically a business’s boundary spanners, the link between the organization and 
the external environments. Since they are in touch with these outside entities, they commonly 
provide essential business data. Sales representatives’ reports frequently alert managers to changes 
in competitors’ prices and new product offerings. It also may involve the types of complaints 
salespeople are hearing from customers. As trends become evident, this data may become business 
intelligence, leading to a change in product design or service delivery. 


BEHAVIORAL TRACKING 


Modern technology provides new ways of tracking human behavior. Global positioning satellite 
(GPS) systems allow management to track the whereabouts of delivery personnel at all times. 
This is the same system that provides directions through an automobile’s navigation system. For 
example, if your delivery person takes a quick break for nine holes of golf at Weaver Ridge or 


proprietary business 
research 
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The gathering of new data to 
investigate specific problems. 
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EXHIBIT 2.3 Six Major Sources of Input for Decision Support Systems 


Source: 


scanner data 


The accumulated records 
resulting from point of sale 
data recordings. 


decides to stop at Gorman’s Pub for a couple of beers mid-afternoon, management can spot these 
as deviations from the appropriate delivery route. Thus, it can help track which employees are 
doing their jobs well. 

Technology also allows firms to track actual customer behavior. While it’s true that GPS 
tracking data of customers is also sometimes possible, as the photograph suggests, the Internet 
also greatly facilitates customer behavior tracking. For instance, Google tracks the “click-through” 
sequence of customers. Therefore, if a customer is searching for information on refrigerators, and 
then goes to BestBuy.com, Google can track this behavior and use the information to let Best Buy 
know how important it is to advertise on Google and even automate pricing for advertisers." 

Purchase behavior can also be tracked at the point of sale. Scanner data refers to the accumulated 
records resulting from point-of-sale data recordings. In other words, each time products are scanned 
at a checkout counter, the information can be stored. The term single-source data refers to a system’s 


Q 
vA Staying Home at Home Depot every day. Home Depot even asks outside suppliers who may 


The DSS of any organization is no better be involved in information technology (IT) design to spend a 


than the quality of the data input to its few days in an actual Home Depot store. Thus, as Home Depot 
data warehouse. How can firms make sure thatthe implements key innovations in its data networks, the people 
input remains relevant and retains a “high-touch” helping it to do so understand what the information needs 
component in a “high-tech” world? of employees really are. Even Home Depot's outside directors 
Home Depot has always tried to make sure its execu- meet with middle managers and conduct store visits so that 
tives “stay in touch” by requiring them to spend a substantial they can provide more meaningful advice to senior executives. 


amount of time on the sales floor of a Home Depot store, which Part of this advice concerns the data needs of Home Depot 

means that one of the folks in the bright orange apron helping managers. 

you choose the right flush valve may well be a six-figure execu- Do you think such a plan would be similarly successful for a 

tive. When Jack VanWoerkom was named new executive vice company like Krispy Kreme? 

president, general counsel, and corporate secretary in 2007, his 

first tasks were not at the corporate headquarters in Atlanta, Sours Lulen, Joana “hieme Deset 
i i Board Gains Insight from Trenches, 

but rather working in the aisles of a store. Therefore, the people The wall Street Journal (October 10, 
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who decide what should go into the data warehouse and 2005), B3; Tucker, Katheryn Hayes , 
h the DSS will it intai jati forthet “New Home Depot GC Learns Ropes 
ow the will use it maintain an appreciation for the types isore Folan CU DA Rari a 
o of decisions faced by Home Depot store managers each and (July 18, 2007). p 
EH 
5 
= 
< 
@ 
ability to gather several types of ~J — 


interrelated data, such as type of 
purchase, use of a sales promotion, 
or advertising frequency data, 
from a single source in a format 
that will facilitate integration, 
comparison, and analysis. 


Outside vendors and external 
distributors market information 
as their products. Many organiza- 
tions specialize in the collection 
and publication of high-quality 
information. One outside ven- 
dor, the ACNielsen Company, 
provides television program rat- 
ings, audience counts, and infor- 
mation about the demographic 
composition of television viewer 
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groups. Other vendors specialize 


GPS devices, like those used 


: 2 as : . , _ . in automobile navigation 
tion. Public libraries have always purchased information, traditionally in the form of books, and systems, allow management to 


they have served as distributors of this information. track delivery personnel or even 
Media representatives often provide useful demographic and lifestyle data about their audiences. actual customer behavior. 

Advertising Age, The Wall Street Journal, Sales and Marketing Management, and other business-oriented 

publications are important sources of information. These publications keep managers up-to-date 


in the distribution of informa- 


about the economy, competitors’ activities, and other aspects of the business environment. 
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data wholesalers 


Companies that put together 
consortia of data sources into 
packages that are offered to 
municipal, corporate, and univer- 
sity libraries for a fee. 


Part 1: Introduction 


Companies called data specialists record and store certain business information. Computer 
technology has changed the way many of these organizations supply data, favoring the develop- 
ment of computerized databases. 


Computerized Data Archives 


Historically, collections of organized and readily retrievable data were available in printed form at 
libraries. The Statistical Abstract of the United States, which is filled with tables of statistical facts, is 
a typical example. As with many resources, the Statistical Abstract is now available electronically. 
Users can purchase it via CD-ROM or access it via the Internet. The entire 2000 U.S. census, the 
2007 Economic Census, as well as projections through the current year is available at http://www. 
census.gov. More and more data are available in digitized form every day. 

Numerous computerized search and retrieval systems and electronic databases are available as 
subscription services or in libraries. Just as a student can query the school library to find informa- 
tion for a term paper without leaving home, data acquisition for businesses has also become far 
more convenient in recent years. Today, business people access online information search and 
retrieval services, such as Dow Jones News Retrieval and Bloomberg Financial Markets, without 
leaving their offices. In fact, an increasing range of information services can be accessed from 
remote locations via digital wireless devices. 

Modern library patrons can command a computer to search indexes and retrieve databases 
from a range of vendors. Just as wholesalers collect goods from manufacturers and offer them 
for sale to retailers who then provide them to consumers, many information firms serve as data 
wholesalers. Data wholesalers put together consortia of data sources into packages that are offered 
to municipal, corporate, and university libraries for a fee. Information users then access the data 
through these libraries. Some of the better known databases include Wilson Business Center, 
Hoovers, PROQUEST, INFOTRAC, DIALOG (Dialog Information Services, Inc.), LEXIS- 
NEXIS, and Dow Jones News Retrieval Services. These databases provide all types of information 
including recent news stories and data tables charting statistical trends. 

DIALOG, for example, maintains more than 600 databases. A typical database may have a 
million or more records, each consisting of a one- or two-paragraph abstract that summarizes the 
major points of a published article along with bibliographic information. One of the DIALOG 
databases, ABI/INFORM, abstracts significant articles in more than one thousand current business 
and management journals. Many computerized archives provide full-text downloads of published 
articles about companies and various research topics. 

Exhibit 2.4 illustrates the services provided by two popular vendors of information services 
that electronically index numerous databases. For a more extensive listing, see the Gale Directory 
of Databases."' 

Several types of databases from outside vendors and external distributors are so fundamental 
to decision support systems that they deserve further explanation. The following sections discuss 
statistical databases, financial databases, and video databases in slightly more detail. 


STATISTICAL DATABASES 


Statistical databases contain numerical data for analysis and forecasting. Often demographic, sales, 
and other relevant business variables are recorded by geographical area. Geographic information 
systems use these geographical databases and powerful software to prepare computer maps of relevant 
variables. Companies such as Claritas, Urban Decision Systems, and CACI all offer geographic/ 
demographic databases that are widely used in industry. 

One source for these huge data warehouses is scanner data. Substituting electronic record- 
keeping like optical scanners for human record-keeping results in greater accuracy and more rapid 
feedback about store activity. 

One weakness of scanner data is that not all points of sale have scanner technology. For 
instance, many convenience stores lack scanner technology, as do most vending machines. Thus, 
those purchases go unrecorded. The Universal Product Code, or UPC, contains information on 
the category of goods, the manufacturer, and product identification based on size, flavor, color, 
and so on. This is what the optical scanner actually reads. If a large percentage of a brand’s sales 
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Vendors of Information Services and Electronic Indexing 


Vendors 


DIALOG 


Selected Databases 


ABI/INFORM 


ASI (American Statistics Index) 


PROMT (The Predicast Overview of 
Markets and Technologies) 


Type of Data 


Summaries and citations from over 
1,000 academic management, 
marketing, and general business 
journals with full text of more than 
500 of these publications 


Abstracts and indexes of federal 
government statistical publications 


Summaries and full text from 1,000 
U.S. and international business and 


trade journals, industry newsletters, 
newspapers, and business research 
studies; information about 
industries and companies, including 
the products and technologies they 
develop and the markets in which 
they compete 


Investext Full text of over 2 million company, 
industry, and geographic research 
reports written by analysts at more 
than 600 leading investment banks, 
brokerage houses, and consulting 
firms worldwide 


Articles from New York Times, Los 
Angeles Times, Washington Post, 
and other leading newspapers and 
magazines 


Dow Jones News Retrieval Business Newsstand 


Historical Data Center Historical data on securities, 
dividends, and exchange rates 


Web Center Information obtained from searches 
of corporate, industry, government, 
and news Web sites 


occur in environments without the ability to read the UPC code, the business should be aware 
that the scanner data may not be representative. 


FINANCIAL DATABASES 


Competitors’ and customers’ financial data, such as income statements and balance sheets, are of 
obvious interest to business managers. These are easy to access in financial databases. CompuStat 
publishes an extensive financial database on thousands of companies, broken down by industry and 
other criteria. To illustrate the depth of this pool of information, CompuStat’s Global Advantage 
offers extensive data on 6,650 companies in more than 30 countries in Europe, the Pacific Rim, 
and North America. 


VIDEO DATABASES 


Video databases and streaming media are having a major impact on many goods and services. For 
example, movie studios provide clips of upcoming films and advertising agencies put television 
commercials on the Internet (see http://www.adcritic.com). McDonald’s maintains a digital archive of 
television commercials and other video footage to share with its franchisees around the world. The 
video database enables franchisees and their advertising agencies to create local advertising without 
the need for filming the same types of scenes already archived. Just imagine the value of digital 
video databases to advertising agencies’ decision support systems! 
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Electronic data storage is 
revolutionizing some research 
tasks. Thousands of television 


commercials and employee 
training films are available for 
analysis by just searching the 
right electronic video database. 


electronic data 
interchange (EDI) 


Type of exchange that occurs 
when one company's computer 
system is integrated with another 
company's system. 


Internet 


A worldwide network of comput- 
ers that allows users access to 
information from distant sources. 
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Networks and 
Electronic Data 
Interchange 


Individual personal computers can 
be connected through networks 
ee, to other computers. Networking 
involves linking two or more com- 
puters to share data and software. 

Electronic data interchange 
(EDI) systems integrate one com- 
pany’s computer system directly 
with another company’s system. 
Much of the input to a com- 
pany’s decision support system 
may come through networks 
from other companies’ comput- 
ers. Companies such as Com- 
puter Technology Corporation 
and Microelectronics data ser- 
vices allow corporations to 
exchange business information with suppliers or customers. For example, every evening Wal- 
Mart transmits millions of characters of data about the day’s sales to its apparel suppliers. Wran- 
gler, a supplier of blue jeans, for instance, shares the data and a model that interprets the data. 
Wrangler also shares software applications that act to replenish stock in Wal-Mart stores. This 
DSS lets Wrangler’s managers know when to send specific quantities of specific sizes and colors 
of jeans to specific stores from specific warehouses. The result is a learning loop that lowers 
inventory costs and leads to fewer stockouts. 


The Internet and Research 


When most readers of this book were born, the Internet had yet to enter the everyday vocabulary. 
In fact, few people outside of a small number of universities and the U.S. Department of Defense 
had any clue as to what the Internet might be. In the 1960s, mainframe computers revolutionized 
research by allowing researchers to use research techniques involving large numbers of math- 
ematical computations that previously would have been impossible or, at the least, impractical. In 
the 1980s, the mainframe computing power of the 1960s, which was available primarily in large 
universities, government agencies, and very large companies, was transformed into something that 
could go on nearly every businessperson’s desktop. The personal computer (PC) and simple oper- 
ating systems like DOS and eventually Windows revolutionized many business applications by 
making computing power relatively inexpensive and convenient. Today, the widespread usage of 
the Internet is perhaps the single biggest change agent in business research. Since most readers are 
no doubt experienced in using the Internet, we highlight a few terms and facts about the Internet 
that are especially useful in understanding business research. 

In the following pages we discuss the World Wide Web and how to use the Internet for 
research. However, keep in mind that the Internet is constantly changing. The description of the 
Internet, especially home page addresses, may be out of date by the time this book is published. 
Be aware that the Internet of today will not be the Internet of tomorrow. 


What Exactly Is the Internet? 


The Internet is a worldwide network of computers that allows users access to data, information, 
and feedback from distant sources. It functions as the world’s largest public library, providing 
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access to a seemingly endless range of data. Many people believe the Internet is the most important 
communications medium since television. 

The Internet began in the 1960s as an experimental connection between computers at Stanford 
University, the University of California at Santa Barbara, the University of California at Los Angeles, 
and the University of Utah, in conjunction with the Department of Defense.'? The Department of 
Defense was involved because it wanted to develop a communications network that could survive 
nuclear war. The Internet gradually grew into a nationwide network of connected computers, and 
now it is a worldwide network often referred to as the “information superhighway.” 

The Internet has no central computer; instead, each message sent bears an address code that 
lets a sender forward a message to a desired destination from any computer linked to the Net. 
Many benefits of the Internet arise because the Internet is a collection of thousands of small net- 
works, both domestic and foreign, rather than a single computer operation. 

A domain is typically a company name, institutional name, or organizational name associated 
with a host computer. A host is where the content for a particular Web site physically resides 
and is accessed. For example, Forbes magazine’s Internet edition is located at http://forbes.com. The 
“com” indicates this domain is a commercial site. Educational sites end in “edu””—Louisiana Tech 
can be reached at http://www.latech.edu and Bradley University can be accessed at http://www.bradley.edu. 
The United States Marine Corps can be found at http://www.marines.mil (the “mil” indicating mili- 
tary) and many government sites, such as the U.S. House of Representatives, end with “gov,” 


as in http://www.house.gov and http://census.gov. Many nonprofit organizations end in “org,” as in 
http://www.ams-web.org, the Web home for the Academy of Marketing Science. Web addresses out- 


> 


side the United States often end in abbreviations for their country such as “ca,” “de,” or “uk” for 


Canada, Germany (Deutschland), and the United Kingdom, respectively. 


How Is the Internet Useful in Research? 


The Internet is useful to researchers in many ways. In fact, more and more applications become 
known as the technology grows and is adopted by more and more users. The Internet is particu- 
larly useful as a source for accessing available data and as a way of collecting data. 


ACCESSING AVAILABLE DATA 


The Internet allows instantaneous and effortless access to a great deal of information. Noncom- 
mercial and commercial organizations make a wealth of data and other resources available on the 
Internet. For example, the U.S. Library of Congress provides full text of all versions of House 
and Senate legislation and full text of the Congressional Record. The Internal Revenue Service 
makes it possible to obtain information and download a variety of income tax forms. Cengage 
Learning (www.cengage.com) and its college divisions (www.cengage.com/highered/) have online direc- 
tories that allow college professors to access information about the company and its textbooks. 
The Gale Research Database provides basic statistics and news stories on literally thousands of 
companies worldwide. Thus, information that formally took a great deal of time and effort to 
obtain is now available with a few clicks. Further, since it can often be electronically downloaded 
or copied, it isn’t necessary for a person to transcribe the data. Therefore, it is available in a more 
error-free form. 


COLLECTING DATA 


The Internet is also revolutionizing the way researchers collect data. Later in this text, we discuss 
in more detail the use of Web-based surveys. In short, questionnaires can be posted on a Web site 
and respondents can be invited to go to the particular URL and participate in the survey. This 
cuts down on the expense associated with traditional mail surveys and also reduces error since the 
data can be automatically recorded rather than transcribed from a paper form into an electronic 
format. 

Furthermore, when a consumer uses the World Wide Web, his or her usage leaves a record 
that can be traced and observed. For instance, Zappos.com can determine how many pages were 
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host 


Where the content for a particu- 
lar Web site physically resides 
and is accessed. 
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economic change. 


—wNicholas Negroponte 


World Wide Web (WWW) 


A portion of the Internet that is a 
system of computer servers that 
organize information into docu- 

ments called Web pages. 


content providers 


Parties that furnish information 
on the World Wide Web. 


uniform resource 
locator (URL) 


A Web site address that Web 
browsers recognize. 


search engine 


A computerized directory that 
allows anyone to search the 
World Wide Web for information 
using a keyword search. 


keyword search 


Takes place as the search engine 

searches through millions of Web 
pages for documents containing 

the keywords. 


interactive medium 


A medium, such as the Internet, 
that a person can use to com- 
municate with and interact with 
other users. 
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visited at their shopping site before a purchase was made. They can see if products were abandoned 
in the “virtual shopping cart” without a purchase being made. Online auctions provide another 
mechanism to track consumers’ behavior. Prototype products can be offered for sale in an online 
auction to help assist with product design, forecasting demand, and setting an appropriate price." 


Navigating the Internet 


The World Wide Web (WWW) refers specifically to that portion of the Internet made up of serv- 
ers that support a retrieval system that organizes information into documents called Web pages. 
World Wide Web documents, which may include graphic images, video clips, and sound clips, are 
formatted in programming languages, such as HTML (HyperText Markup Language) and XML 
(Extensible Markup Language) that allow for displaying, linking, and sharing of information on 
the Internet. 

Parties that furnish information on the World Wide Web are called content providers. Con- 
tent providers maintain Web sites. A Web site consists of one or more Web pages with related 
information about a particular topic; for example, Bradley University’s Web site includes pages 
about its mission, courses, athletics, admissions, and faculty (see http://www.bradley.edu). The intro- 
ductory page or opening screen is called the home page because it provides basic information 
about the purpose of the document along with a menu of selections or links that lead to other 
screens with more specific information. Thus, each page can have connections, or hyperlinks, to 
other pages, which may be on any computer connected to the Internet. People using the World 
Wide Web may be viewing information that is stored on a host computer or on a machine halfway 
around the world. 

Most Web browsers also allow the user to enter a uniform resource locator (URL) into the 
program. The URL is really just a Web site address that Web browsers recognize. Many Web 
sites allow any user or visitor access without previous approval. However, many commercial sites 
require that the user have a valid account and password before access is granted. 

One of the most basic research tools available via the Internet is a search engine. A search 
engine is a computerized directory that allows anyone to search the World Wide Web for infor- 
mation based on a keyword search. A keyword search takes place as the search engine searches 
through millions of Web pages for documents containing the keywords. Some of the most com- 
prehensive and accurate search engines are: 


Yahoo! http://www.yahoo.com 
Google http://www.google.com 
Hotbot http://www.hotbot.com 

Go network http://www.go.com 

Excite http://www.excite.com 
Lycos http://www.lycos.com 

Ask Jeeves http://www.ask.com 
WebCrawler http://www.webcrawler.com 


Google revolutionized search engines by changing the way the search was actually conducted. 
It searches based on a mathematical theory known as graph theory.'* Google greatly improved the 
accuracy and usefulness of the search results obtained from a keyword search. In fact, “google” 
is now included as a word in many dictionaries, meaning “to search for information on the 
World Wide Web.” Exhibit 2.5 illustrates the Google interface and expanded Google options. 
For instance, if one clicks on Google Scholar, a search of citations for a particular author or basic 
research papers on any given topic indicated by the keywords can be performed. 


Interactive Media and Environmental Scanning 


The Internet is an interactive medium because users click commands and often get customized 
responses. So the user and equipment can have a continuing conversation. Two or more individuals 
who communicate one-to-one via e-mail using an Internet service provider are also using interactive 
media. So are individuals who communicate with many senders and receivers via bulletin boards 
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EXHIBIT 2.5 The Google Web Interface 
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or chat rooms. Because of its vastness, the Internet is an especially useful source for scanning many 
types of environmental changes. Environmental scanning entails all information gathering designed 
to detect changes in the external operating environment of the firm. These things are usually beyond 
the control of the firm, but they still can have a significant impact on firm performance. 

Ford Motor Company maintains an Internet-based relationship marketing program that, 
among other things, helps the automaker scan its environment using the Internet. Its dealer Web 
site creates a centralized communication service linking dealers via an Internet connection. Its 
buyer Web site allows prospective buyers to visit a virtual showroom and to get price quotes and 
financial information. Its owner Web site allows an owner who registers and supplies pertinent 
vehicle information to get free e-mail and other ownership perks. A perk might be a free Hertz 
upgrade or an autographed photo of one of the Ford-sponsored NASCAR drivers. In return, Ford 
collects data at all levels, which allow managers to scan for trends and apply what they learn at a 
local level. 


Information Technology 


Data and information can be delivered to consumers or other end users via either pull technology 
or push technology. Conventionally, consumers request information from a Web page and the 
browser then determines a response. Thus, the consumer is essentially asking for the data. In this 
case, it is said to be pulled through the channel. The opposite of pull is push. Push technology sends 
data to a user’s computer without a request being made. In other words, software is used to guess 
what information might be interesting to consumers based on the pattern of previous responses. 
Smart information delivery (known by a variety of technical names, including push phase tech- 
nology) allows a Web site, such as the Yahoo portal, to become a one-on-one medium for each 
individual user. Today’s information technology uses “smart agents” or “intelligent agents” to 
deliver customized content to a viewer’s desktop. Smart agent software is capable of learning an 
Internet user’s preferences and automatically searching out information and distributing the infor- 
mation to a user’s computer. My Yahoo! and MyExcite are portal services that personalize Web 
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environmental scanning 


Entails all information gathering 
designed to detect changes in 
the external operating environ- 
ment of the firm. 


pull technology 


Consumers request informa- 
tion from a Web page and the 
browser then determines a 
response; the consumer is essen- 
tially asking for the data. 


push technology 


Sends data to a user's computer 
without a request being made; 
software is used to guess what 
information might be interesting 
to consumers based on the pat- 
tern of previous responses. 


smart agent software 


Software capable of learning an 
Internet user's preferences and 
automatically searching out infor- 
mation in selected Web sites and 
then distributing it. 
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The iPhone offers one example 
of how modern technology 
makes it possible to store and 
deliver information, providing 
cellular communication and 
contacts, e-mail capabilities, 
calendar functions, GPS 
mapping, and music 
downloads, among a host 

of other capabilities. 


cookies 


Small computer files that a con- 
tent provider can save onto the 
computer of someone who visits 
its Web site. 


intranet 


A company’s private data net- 
work that uses Internet standards 
and technology. 
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pages. Users can get stock quotes relevant to their portfolios, 
news about favorite sports teams, local weather, and other per- 
sonalized information. Users can customize the sections of the 
service they want delivered. With push technology, pertinent 
content is delivered to the viewer’s desktop without the user 
having to do the searching. 

Cookies, in computer terminology, are small computer files 
that record a user’s Web usage history. If a person looks up a 
weather report by keying a zip code into a personalized Web 
page, the fact that the user visited the Web site and the zip 
code entered are recorded in the cookie. This is a clue that 
tells where the person lives (or maybe where he or she may be 
planning to visit). Web sites can then direct information to that 
consumer based on information in the cookie. So, someone in 
Hattiesburg, Mississippi, may receive pop-up ads for restaurants 
in Hattiesburg. Information technology is having a major impact 
on the nature of business research. We will explore this topic in 
several places throughout this book. 


Intranets 


An intranet is a company’s private data network that uses 
Internet standards and technology. The information on an 
intranet—data, graphics, video, and voice—is available only 
inside the organization or to those individuals whom the organi- 
zation deems as appropriate participants. Thus, a key difference 
between the Internet and an intranet is that security software 
programs, or “firewalls,” are installed to limit access to only 
those employees authorized to enter the system. Intranets then 
serve as secure knowledge portals that contain substantial amounts of organizational memory and 
can integrate it with information from outside sources. For example, Caterpillar has an intranet 
that includes their knowledge network, a portal that provides Caterpillar employees and dealer- 
ship personnel with a vast array of information about the company and its product offering. The 
challenge in designing an intranet is making sure that it is capable of delivering relevant data to 
decision makers. Research suggests that relevance is a key in getting knowledge workers to actu- 
ally make use of company intranets.'° 

An intranet can be extended to include key consumers as a source of valuable research. Their 
participation in an intranet can lead to new product developments. Texas Instruments has success- 
fully established an intranet that integrated communications between customers and researchers 
leading to the introduction and modification of its calculators.” An intranet lets authorized users, 
possibly including key customers, look at product drawings, employee newsletters, sales figures, 
and other kinds of company information. 


Internet2 


As we mentioned earlier, information technology changes rapidly. As sophisticated as the Internet 
and intranets are today, new technologies, such as Internet2, will dramatically enhance researchers’ 
ability to answer business problems in the future. 

Internet2 (http://www.internet2.edu/) is a collaborative effort involving about 250 universities, 
government entities (including the military), and corporate organizations. The project hopes to 
recreate some of the cooperative spirit that created the Internet originally. Internet2 users are lim- 
ited to those involved with the affiliate organizations. The hope is to create a faster, more powerful 
Internet by providing multimodal access, employing more wireless technologies, and building in 
global trading mechanisms. Internet2 began as a research tool for the universities and organizations 
involved in its development.'* 
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Summary 


1. Know and distinguish between the concepts of data, information, and intelligence. Increased 
global competition and technological advances in interactive media have spurred development of 
global information systems. A global information system is an organized collection of computer 
hardware, software, data, and personnel designed to capture, store, update, manipulate, analyze, 
and immediately display information about worldwide business activity. 

From a research perspective, there is a difference between data, information, and intelligence. 
Data are simply facts or recorded measures of certain phenomena (things); information is data 
formatted (structured) to support decision making or define the relationship between two facts. 
Business intelligence is the subset of data and information that actually has some explanatory 
power enabling effective decisions to be made. 


2. Understand the four characteristics that describe data. The usefulness of data to management 
can be described based on four characteristics: relevance, quality, timeliness, and completeness. 
Relevant data have the characteristic of pertinence to the situation at hand. The information is 
useful. The quality of information is the degree to which data represent the true situation. High- 
quality data are accurate, valid, and reliable. High-quality data represent reality faithfully and 
present a good picture of reality. Timely information is obtained at the right time. Computerized 
information systems can record events and present information as a transaction takes place, 
improving timeliness. Complete information is the right quantity of information. Managers must 
have sufficient information to relate all aspects of their decisions together. 


3. Know the purpose of research in assisting business operations. A computer-based decision 
support system helps decision makers confront problems through direct interactions with data- 
bases and analytical models. A DSS stores data and transforms them into organized information 
that is easily accessible to managers. 


4. Know what a decision support system is and does. A database is a collection of raw data arranged 
logically and organized in a form that can be stored and processed by a computer. Business data 
come from four major sources: internal records, proprietary business research, business intelligence, 
and outside vendors and external distributors. Each source can provide valuable input. Because 
most companies compile and store many different databases, they often develop data warehousing 
systems. Data warehousing is the process allowing important day-to-day operational data to be 
stored and organized for simplified access. More specifically, a data warehouse is the multitiered 
computer storehouse of current and historical data. Data warehouse management requires that the 
detailed data from operational systems be extracted, transformed, and stored (warehoused) so that 
the various database tables from both inside and outside the company are consistent. All of this 
feeds into the decision support system that automates or assists business decision making. 

Numerous database search and retrieval systems are available by subscription or in libraries. 
Computer-assisted database searching has made the collection of external data faster and easier. 
Managers refer to many different types of databases. 

Although personal computers work independently, they can connect to other computers in 
networks to share data and software. Electronic data interchange (EDI) allows one company’s 
computer system to join directly to another company’s system. 


5. Recognize the major categories of databases. The Internet is a worldwide network of com- 
puters that allows users access to information and documents from distant sources. It is a combi- 
nation of a worldwide communication system and the world’s largest public library. The World 
Wide Web is a system of thousands of interconnected pages, or documents, that can be easily 
accessed with Web browsers and search engines. 
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An intranet is a company’s private data network that uses Internet standards and technology. 
The information on an intranet—data, graphics, video, and voice—is available only inside the 
organization. Thus, a key difference between the Internet and an intranet is that “firewalls,” or 
security software programs, are installed to limit access to only those employees authorized to 


enter the system. 


A company uses Internet features to build its own intranet. Groupware and other technol- 
ogy can facilitate the transfer of data, information, and knowledge. In organizations that practice 
knowledge management, intranets function to make the knowledge of company experts more 
accessible throughout their organizations. 


Key Terms and Concepts 


business intelligence, 19 
content providers, 32 


cookies, 34 global information system, 23 
customer relationship management (CRM), 23 host, 31 
data, 19 information, 19 


data quality, 21 

data warehouse, 24 
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data warehousing, 24 
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scanner data, 26 

search engine, 32 

smart agent software, 33 
timeliness, 21 

uniform resource locator (URL), 32 
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Questions for Review and Critical Thinking 


1. What is the difference between data, information, and intelligence? 


2. What are the characteristics of useful information? 


3. What is the key question distinguishing relevant data from irrel- 


evant data? 

4. Define knowledge management. What is its purpose within an 
organization? 

5. What types of databases might be found in the following 
organizations? 
a. Holiday Inn 
b. A major university’s athletic department 
c. Anheuser-Busch 

6. What type of operational questions could a delivery firm like 


FedEx expect to automate with the company’s decision support 


system? 
7. What makes a decision support system successful? 


Se 


What is data warehousing? 

9. "NET How does data warehousing assist decision making? Visit 
http://www.kbb.com. While there, choose two cars that you 
might consider buying and compare them. Which do you like 
the best? What would you do now? What are at least three 
pieces of data that should be stored in a data warehouse some- 
where based on your interaction with Kelly Blue Book? 


Research Activities 


1. ‘NET To learn more about data warehousing, go to http://www. 


datawarehousing.org. 
2. ‘NET Use the Internet to see if you can find information to 
answer the following questions: 


10. 


11. 


12: 


13: 


14. 


15: 


‘NET Give three examples of computerized databases that are 
available at your college or university library. 

‘NET What is the difference between the Internet and an 
intranet? 

Suppose a retail firm is interested in studying the effect of light- 
ing on customer purchase behavior. Which of the following 
pieces of information is the least relevant and why? 

a. Amount of natural light in the store 

b. The compensation system for store salespeople 

c. The color of the walls in the store 

d. The type of lighting: fluorescent or incandescent 

‘NET Imagine the data collected by eBay each day. List at least 
five types of data that are collected through the daily opera- 
tions. Describe each in terms of it illustrating data, information, 
or intelligence. Make sure you list at least one of each. 

How could New Balance, a maker of athletic shoes, use RFID 
technology to collect data? 

‘NET The Spider’s Apprentice is a Web site that provides many 
useful tips about using search engines. Go to http://www.monash. 
com/spidap.html, then click on Search Engine FAQ to learn the 
ins and outs of search engines. 


a. What is the weather in Angers, France, today? 

b. What are four restaurants in the French Quarter in New 
Orleans? 

c. What is the population of Brazil? 
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Case 2.1 Harvard Cooperative Society 
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From his office window overlooking the main 
floor of the Harvard Cooperative Society, CEO 
Jerry Murphy can glance down and see custom- 
ers shopping.” They make their way through the 
narrow aisles of the crowded department store, 
picking up a sweatshirt here, trying on a baseball 
cap there, checking out the endless array of merchandise that bears 
the Harvard University insignia. 

Watching Murphy, you can well imagine the Co-op’s found- 
ers, who started the store in 1882, peering through the tiny win- 
dowpanes to keep an eye on the shop floor. Was the Harvard 
Square store attracting steady traffic? Were the college students 
buying enough books and supplies for the Co-op to make a profit? 
Back then, it was tough to answer those questions precisely. The 
owners had to watch and wait, relying only on their gut feelings to 
know how things were going from minute to minute. 

Now, more than a hundred years later, Murphy can tell you, 
down to the last stock-keeping unit, how he’s doing at any given 
moment. His window on the business is the PC that sits on his 


desk. All day long it delivers up-to-the-minute, easy-to-read elec- 
tronic reports on what’s selling and what’s not, which items are 
running low in inventory and which have fallen short of forecast. In 
a matter of seconds, the computer can report gross margins for any 
product or supplier, and Murphy can decide whether the margins 
are fat enough to justify keeping the supplier or product on board. 
“We were in the 1800s, and we had to move ahead,” he says of the 
$55 million business. 


Questions 

1. What is a decision support system? What advantages does a 
decision support system have for a business like the Harvard 
Cooperative Society? 

2. How would the decision support system of a business like 
the Harvard Cooperative Society differ from that of a major 
corporation? 

3. Briefly outline the components of the Harvard Cooperative 
Society’s decision support system. 


CHAPTER 3 
THEORY BUILDING 
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After studying this chapter, you should be able to 
1. Define the meaning of theory 
2. Understand the goals of theory 
3. Understand the terms concepts, propositions, variables, 
and hypotheses 
4. Discuss how theories are developed 
5. Understand the scientific method 


Chapter Vignette: Theory 


and Practice 
What if you went home tonight and turned on the 
light switch and nothing happened? Most of us 
would immediately start seeking a logical explana- 
tion: “Is the bulb burnt out?” “Did my roommate 
forget to pay the electric bill?” “Is the electricity out?” 
“Did a fuse blow?” These are common thoughts that 
would race through our minds. The order would prob- 
ably depend on our past experience and we would 
try to determine the cause through a logical thought 
sequence. Attribution theory is one framework that 
helps us explain the world and determine the cause 
of an event (the light bulb not working) or behavior 
(why my girlfriend is mad at me). Simply put, this theory 
helps us make sense of events by providing a system- 
atic method to assess and evaluate why things occur. 
Attribution theory is just one of many theoretical models 
that are useful to business researchers. 
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Introduction 


The purpose of science concerns the expansion of knowledge and the search for truth. Theory 
building is the means by which basic researchers hope to achieve this purpose. 

Students sometimes think their classes or course material are “too theoretical” or lacking 
“practical application.” However, this should certainly not be the case. Theories are simply gener- 
alizations that help us better understand reality. Furthermore, theories allow us to understand the 
logic behind things we observe. If a theory does not hold true in practice, then that theory holds 
no value. This chapter will provide a fundamental knowledge of theory, theory development, and 
some terminology regarding theory necessary for business researchers. 


What Is a Theory? 


Like all abstractions, the word “theory” has been used in many different ways, in many different contexts, 
at times so broadly as to include almost all descriptive statements about a class of phenomena, and at other 
times so narrowly as to exclude everything but a series of terms and their relationships that satisfies certain 
logical requirements. ' 


A theory consists of a coherent set of general propositions that offer an explanation of some phe- 
nomena by describing the way other things correspond to this phenomena. Put another way, a 
theory is a formal, testable explanation of some events that includes explanations of how things 
relate to one another. 

A theory can be built through a process of reviewing previous findings of similar studies, 
simple logical deduction, and/or knowledge of applicable theoretical areas. For example, ifa Web 
designer is trying to decide what color background is most effective in increasing online sales, 
he may first consult previous studies examining the effects of color on package design and retail 
store design. He may also find theories that deal with the wavelength of different colors, affective 
response to colors, or those that explain retail atmospherics. This may lead to the specific predic- 
tion that blue is the most effective background color for a Web site.’ 

While it may seem that theory is only relevant to academic or basic business research, theory 
plays a role in understanding practical research as well. Before setting research objectives, the 
researcher must be able to describe the business situation in some coherent way. Without this 
type of explanation, the researcher would have little idea of where to start. Ultimately, the logical 
explanation helps the researcher know what variables need to be included in the study and how 
they may relate to one another. The Research Snapshot on page 41 illustrates how theory and 
practice come together in marketing research. 


What Are the Goals of Theory? 


Suppose a researcher investigating business phenomena wants to know what caused the financial 
crisis. Another person wants to know if organizational structure influences leadership style. Both 
of these individuals want to gain a better understanding of the environment and be able to predict 
behavior; to be able to say that if we take a particular course of action we can expect a specific out- 
come to occur. These two issues—understanding and predicting—are the two purposes of theory.’ 
Accomplishing the first goal allows the theorist to gain an understanding of the relationship among 
various phenomena. For example, a financial advisor may believe, or theorize, that older investors 
tend to be more interested in investment income than younger investors. This theory, once veri- 
fied, would then allow her to predict the importance of expected dividend yield based on the age 
of her customer. Thus a theory enables us to predict the behavior or characteristics of one phenom- 
enon from the knowledge of another phenomenon. The value of understanding and anticipating 
future conditions in the environment or in an organization should be obvious. In most situations, 
of course, understanding and prediction go hand in hand. To predict phenomena, we must have an 
explanation of why variables behave as they do. Theories provide these explanations. 
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—Kurt Lewin 


theory 


A formal, logical explanation of 
some events that includes pre- 
dictions of how things relate to 
one another. 


—Karl R. Popper, 
The Logic of Scientific 
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Go online to the Internet survey you completed for the Chapter 1 
assignment. Please go back and review all the questions included 


© No 


on the survey. Following our discussion of theory 

in this chapter, you should have a solid foundation 
in understanding theory develop- 
ment and the importance of theory 
in business research. Considering the 
questions asked in the survey, build 
a theory about the relationship among at least four 
questions. How do you think the responses to these 
questions should relate? Why? Provide a theoretical 
explanation for the relationships you are proposing. 


concept (or construct) 


A generalized idea about a class 
of objects that has been given 
a name; an abstraction of reality 
that is the basic unit for theory 
development. 


ladder of abstraction 


Organization of concepts in 
sequence from the most con- 
crete and individual to the most 
general. 


abstract level 


In theory development, the level 
of knowledge expressing a con- 
cept that exists only as an idea or 
a quality apart from an object. 


empirical level 


Level of knowledge that is 
verifiable by experience or 
observation. 


40 


Research Concepts, Constructs, 
Propositions, Variables, and Hypotheses 


Theory development is essentially a process of describing phenomena at increasingly higher levels 
of abstraction. In other words, as business researchers, we need to be able to think of things in a 
very abstract manner, but eventually link these abstract concepts to observable reality. To under- 
stand theory and the business research process, it will be useful to know different terminology and 
how these terms relate. 


Research Concepts and Constructs 


A concept or construct is a generalized idea about a class of objects, attributes, occurrences, or 
processes that has been given a name. If you, as an organizational theorist, were to describe phe- 
nomena such as supervisory behavior or risk aversion, you would categorize empirical events or 
real things into concepts. Concepts are the building blocks of theory. In organizational theory, 
leadership, productivity, and morale are concepts. In the theory of finance, gross national prod- 
uct, risk aversion, and inflation are frequently used concepts. Accounting concepts include assets, 
liabilities, and depreciation. In marketing, customer satisfaction, market share, and loyalty are 
important concepts. 

Concepts abstract reality. That is, concepts express in words various events or objects. Con- 
cepts, however, may vary in degree of abstraction. For example, the concept of an asset is an 
abstract term that may, in the concrete world of reality, refer to a wide variety of things, includ- 
ing a specific punch press machine in a production shop. The abstraction ladder in Exhibit 3.1 
indicates that it is possible to discuss concepts at various levels of abstraction. Moving up the 
ladder of abstraction, the basic concept becomes more general, wider in scope, and less amenable 
to measurement. 

The basic or scientific business researcher operates at two levels: on the abstract level of con- 
cepts (and propositions) and on the empirical level of variables (and hypotheses). At the empiri- 
cal level, we “experience” reality—that is, we observe, measure, or manipulate objects or events. 
For example, we commonly use the term job performance, but this is an abstract term that can 
mean different things to different people or in different situations. To move to the empirical 
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bg Nothing So Practical as Theory? 
“Business theory and practice do come 
together. First, students learn theory in 
their formal education. Business professors con- 
sider it good practice to blend theory and practice 
in their teaching. Business professionals use these theories to 
help shape their thinking about different business situations. 
Neurology, psychobiology, anthropology, economics, and 
social psychology all offer relevant theories that can help explain 
business problems. Recently, structuration theory has been pro- 
posed as a way of explaining business communication outcomes. 
The theory suggests that more focus should be placed on the 
communication exchanges between buyers and sellers and that if 
one can understand the goals of the buyer and seller involved in 
a communication interaction, then the outcome of the interaction 
can be predicted. Studies using a theory like this may assist 


Assets 


Plant Machinery 


Punch Press 


Reality 


electronic communication 
design in better placements 
of pop-up ads and hyperlinks 
and can also assist face-to- 
face sales exchanges in better 
predicting when a consumer is 
actually ready to buy. 


Sources: Green, Paul E., “Theory, 
Practice Both Have Key MR Roles,’ 
Marketing News 38 (September 

15, 2004), 40-44; Schultz, Don, 
“Accepted Industry Truths Not Always 
Acceptable,’ Marketing News 39 
(October 15, 2005), 6; Stewart, D. T., 
“Traditional Ad Research Overlooks 
Interactions,’ Marketing News 39 
(November 15, 2005), 26-29. 


level, we must more clearly define this construct and identify actual measures that we can assess 
and measure to represent job performance as shown in Exhibit 3.2. In research, we use the term 
latent construct to refer to a concept that is not directly observable or measurable, but can be 
estimated through proxy measures." Job performance, customer satisfaction, and risk aversion are 
just three examples of the many latent constructs in business research. While we cannot directly 


Salesperson 


pes ac mew! Job Performance 


Empirical Level 
Number of Sales Calls 
Number of Sales 
Dollar Value of Sales 


A Ladder of Abstraction for 
Concepts 


latent construct 


A concept that is not directly 
observable or measurable, but 
can be estimated through proxy 
measures. 


Concepts Are Abstractions 
of Reality 
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—Albert Einstein 


propositions 


Statements explaining the logical 
linkage among certain concepts 
by asserting a universal connec- 

tion between concepts. 


hypothesis 


Formal statement of an unproven 
proposition that is empirically 
testable. 


empirical testing 


Examining a research hypothesis 
against reality using data. 


variables 


Anything that may assume differ- 
ent numerical values; the empiri- 
cal assessment of a concept. 


operationalizing 


The process of identifying the 
actual measurement scales to 
assess the variables of interest. 


Part 1: Introduction 


see these latent constructs, we can measure them, and doing so is one of the greatest challenges 
for business researchers. 

If an organizational researcher says “Older workers prefer different rewards than younger 
workers,” two concepts—age of worker and reward preference—are the subjects of this abstract 
statement. If the researcher wishes to test this relationship, John, age 19, Chuck, age 45, and 
Mary, age 62—along with other workers—may be questioned about their preferences for salary, 
retirement plans, intrinsic job satisfaction, and so forth. Recording their ages and assessing their 
reward preferences are activities that occur at the empirical level. In this example, we can see 
that researchers have a much easier time assessing and measuring age than the latent construct of 
reward preference. 

In the end, researchers are concerned with the observable world, or what we shall loosely 
term reality. Theorists translate their conceptualization of reality into abstract ideas. Thus, theory 
deals with abstraction. Things are not the essence of theory; ideas are.* Concepts in isolation are 
not theories. To construct a theory we must explain how concepts relate to other concepts as 
discussed below. 


Research Propositions and Hypotheses 


As we just mentioned, concepts are the basic units of theory development. However, theo- 
ries require an understanding of the relationship among concepts. Thus, once the concepts of 
interest have been identified, a researcher is interested in the relationship among these concepts. 
Propositions are statements concerned with the relationships among concepts. A proposition 
explains the logical linkage among certain concepts by asserting a universal connection between 
concepts. For example, we might propose that treating our employees better will make them 
more loyal employees. This is certainly a logical link between managerial actions and employee 
reactions, but is quite general and not really testable in its current form. 

A hypothesis is a formal statement explaining some outcome. In its simplest form, a hypoth- 
esis is a guess. A sales manager may hypothesize that the salespeople who are highest in product 
knowledge will be the most productive. An advertising manager may hypothesize that if consum- 
ers’ attitudes toward a product change in a positive direction, there will be an increase in con- 
sumption of the product. A human resource manager may hypothesize that job candidates with 
certain majors will be more successful employees. 

A hypothesis is a proposition that is empirically testable. In other words, when one states a 
hypothesis, it should be written in a manner that can be supported or shown to be wrong through 
an empirical test. For example, using the color of the background for a Web site discussed previ- 
ously, the researcher may use theoretical reasoning to develop the following hypothesis: 


H1: A web site with a blue background will generate more sales than an otherwise identical Web site 
with a red background. 


We often apply statistics to data to empirically test hypotheses. Empirical testing means that 
something has been examined against reality using data. The abstract proposition “Treating our 
employees better will make them more loyal employees” may be tested empirically with a hypoth- 
esis. Exhibit 3.3 shows that the hypothesis “Increasing retirement benefits will reduce intention 
to leave the organization” is an empirical counterpart of this proposition. Retirement benefits 
and intention to leave are variables, reflecting the concepts of employee treatment and employee 
loyalty. When the data are consistent with a hypothesis, we say the hypothesis is supported. When 
the data are inconsistent with a hypothesis, we say the hypothesis is not supported. We are often 
tempted to say that we prove a hypothesis when the data conform to the prediction, but this isn’t 
really true. Because our result is based on statistics, there is always the possibility that our con- 
clusion is wrong. Now, at times we can be very, very confident in our conclusion, but from an 
absolute perspective, statistics cannot prove a hypothesis is true. 

Because variables are at the empirical level, variables can be measured. In this case, retirement 
benefits might be measured quite easily and precisely (e.g., the actual percentage change in match- 
ing retirement funds), while the latent construct of intention to leave would be more challenging 
for the researcher. This step is known as operationalizing our variables—the process of identifying 
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Proposition 


Abstract Treat Employees More Loyal 
Level Better Employees 


Hypothesis 


Empirical [Increase Retirement Reduce Annual 
Level Benefits 5% Turnover 


the actual measurement scales to assess the variables of interest. We will discussion operationaliza- 
tion in more detail in Chapter 13. 
Thus, the scientific inquiry has two basic levels: 


. . . the empirical and the abstract, conceptual. The empirical aspect is primarily concerned with the facts 
of the science as revealed by observation and experiments. The abstract or theoretical aspect, on the other 
hand, consists in a serious attempt to understand the facts of the science, and to integrate them into a 
coherent, i.e., a logical, system. From these observations and integrations are derived, directly or indirectly, 
the basic laws of the science.° 


Understanding Theory 


Exhibit 3.4 on the next page is a simplified portrayal of a theory to explain voluntary job 
turnover—the movement of employees to other organizations. Two concepts—(1) the perceived 
desirability of movement to another organization and (2) the perceived ease of movement from the 
present job—are expected to be the primary determinants of intention to quit. This is a proposi- 
tion. Further, the concept intention to quit is expected to be a necessary condition for the actual 
voluntary job turnover behavior to occur. This is a second proposition that links concepts together in 
this theory. In the more elaborate theory, job performance is another concept considered to be the 
primary determinant influencing both perceived ease of movement and perceived desirability of movement. 
Moreover, perceived ease of movement is related to other concepts such as labor market conditions, 
number of organizations visible to the individual, and personal characteristics. Perceived desirability of 
movement is influenced by concepts such as equity of pay, job complexity, and participation in decision 
making. A complete explanation of this theory is not possible; however, this example should help 
you understand the terminology used by theory builders. 


Verifying Theory 


In most scientific situations there are alternative theories to explain certain phenomena. To deter- 
mine which is the better theory, researchers make observations or gather empirical data to verify 
the theories. 

Maslow’s hierarchical theory of motivation offers one explanation of human behavior. Maslow 
theorizes that individuals will attempt to satisfy physiological needs before self-esteem needs. An 
alternative view of motivation is provided by Freudian (psychoanalytic) theory, which suggests 
that unconscious, emotional impulses are the basic influences on behavior. One task of science is 
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EXHIB ; Hypotheses Are 
the Empirical Counterparts 
of Propositions 


—Benedict Spinoza 
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XHIBIT 3.4 A Basic Theory 
Explaining Voluntary Job 
Turnover’ 


—Karl Popper 


deductive reasoning 


The logical process of deriving 
a conclusion about a specific 
instance based on a known 
general premise or something 
known to be true. 


inductive reasoning 


The logical process of establish- 
ing a general proposition on the 
basis of observation of particular 

facts. 
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Labor market conditions, 
number of organizations, 
personal characteristics, and 
other partial determinants 
of ease of movement 


Perceived ease of 
movement (e.g., expectation 
of finding alternatives, 
unsolicited opportunities) 


i Voluntary 
Intention job turnover 


Job performance to quit (individual 


volition) 
Perceived desirability of 
movement (e.g., job 
satisfaction) 


Equity of pay, job complexity, 
participation in decision 
making, and other partial 

determinants of desirability 
of movement 


to determine if a given theoretical proposition is false or if there are inconsistencies between com- 
peting theories. Just as records are made to be broken, theories are made to be tested. 


It must be possible to demonstrate that a given proposition or theory is false. This may at first glance 
appear strange. Why “false” rather than “true”? Technically, there may be other untested theories 
which could account for the results we obtained in our study of a proposition. At the very least, there 
may be a competing explanation which could be the “real” explanation for a given set of research find- 
ings. Thus, we can never be certain that our proposition or theory is the correct one. The scientist can 
only say, “T have a theory which I have objectively tested with data and the data are consistent with my 
theory.” If the possibility of proving an idea false or wrong is not inherent in our test of an idea, then 
we cannot put much faith in the evidence that suggests it to be true. No other evidence was allowed to 
manifest itself.” 


Theory Building 


You may be wondering “Where do theories come from?” Although this is not an easy question 
to answer in a short chapter on theory in business research, we will explore this topic briefly. In 
this chapter, theory has been explained at the abstract, conceptual level and at the empirical level. 
Theory generation may occur at either level. 

At the abstract, conceptual level, a theory may be developed with deductive reasoning by 
going from a general statement to a specific assertion. Deductive reasoning is the logical process of 
deriving a conclusion about a specific instance based on a known general premise or something 
known to be true. For example, while you might occasionally have doubts, we know that all busi- 
ness professors are human beings. If we also know that Barry Babin is a business professor, then we can 
deduce that Barry Babin is a human being. 

At the empirical level, a theory may be developed with inductive reasoning. Inductive 
reasoning is the logical process of establishing a general proposition on the basis of observation of 
particular facts. All business professors that have ever been seen are human beings; therefore, all 
business professors are human beings. 
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A Ballistic Theory 

~ Ballistic theory is a theory because it 
deals with measurable factors, because 

it states their relationships in detail, and because 


any one factor can be fairly completely determined 


by a knowledge of all the others."° Given all of the factors except 
the initial speed of the projectile, an engineer can determine 
what that speed was. Asked to change the point of impact, he 
can suggest several ways in which this can be accomplished—all 
of which will work. 

It is common knowledge that the behavioral sciences are not 
as advanced as the physical sciences. What this means, in effect, 
is that no one has yet defined all of the factors in human behav- 
ior or determined the influence that each has on events. In fact, 


Suppose a stockbroker with 15 years’ experience trading 
on the New York Stock Exchange repeatedly notices that 
the price of gold and the price of gold stocks rise whenever 
there is a hijacking, terrorist bombing, or military skirmish. 
In other words, similar patterns occur whenever a certain 
type of event occurs. The stockbroker may induce from 
these empirical observations the more general situation that 
the price of gold is related to political stability. Thus, the 
stockbroker states a proposition based on his or her expe- 
rience or specific observations: “Gold prices will increase 
during times of political instability.” The stockbroker has 
constructed a basic theory. 

Over the course of time, theory construction is often 
the result of a combination of deductive and inductive rea- 
soning. Our experiences lead us to draw conclusions that 
we then try to verify empirically by using the scientific 
method. 


The Scientific Method 


The scientific method is a set of prescribed procedures for establishing and connecting theoretical 
statements about events, for analyzing empirical evidence, and for predicting events yet unknown. 
It is useful to look at the analytic process of scientific theory building as a series of stages. While 
there is not complete consensus concerning exact procedures for the scientific method, we suggest 
seven operations may be viewed as the steps involved in the application of the scientific method: 


Formulation of concepts and propositions 
Statement of hypotheses 

Design of research to test the hypotheses 
Acquisition of meaningful empirical data 
Analysis and evaluation of data 


SOs Ore SNS 


research!! 


Assessment of relevant existing knowledge of a phenomenon 


no one has really done a very good job of determining what an 
event is. That is, how to measure it or what to consider relevant 
about it. 

Again, an example may help explain the dilemma. It is irrel- 
evant to ballistic theory that John Gingrich is standing beside 
the 155 mm rifle when it is fired. It may not be irrelevant to 
consumer behavior theory that he is standing beside the person 
who selects a necktie. It is not relevant to ballistic theory that 
the gunner’s father once 
carried an M-1. It may be rel- 
evant to consumer behavior 
theory that the automobile 
purchaser's grandfather once 
owned a Ford. 


Noting a link between changes 
in gold prices and political 
instability could be the 
foundation for a basic theory. 


scientific method 


A set of prescribed procedures 
for establishing and connecting 
theoretical statements about 
events, for analyzing empirical 
evidence, and for predicting 
events yet unknown; techniques 
or procedures used to analyze 
empirical evidence in an attempt 
to confirm or disprove prior 
conceptions. 


Proposal of an explanation of the phenomenon and statement of new problems raised by the 
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An excellent overview of the scientific method is presented in Robert Pirsig’s book Zen and the 
Art of Motorcycle Maintenance: 


Actually Pve never seen a cycle-maintenance problem complex enough really to require full-scale formal 
scientific method. Repair problems are not that hard. When I think of formal scientific method an image 
sometimes comes to mind of an enormous juggernaut, a huge bulldozer—slow, tedious, lumbering, 
laborious, but invincible. It takes twice as long, five times as long, maybe a dozen times as long as 
informal mechanic’s techniques, but you know in the end you’re going to get it. There’s no fault isola- 
tion problem in motorcycle maintenance that can stand up to it. When you’ve hit a really tough one, 
tried everything, racked your brain and nothing works, and you know that this time Nature has really 
decided to be difficult, you say, “Okay, Nature, that’s the end of the nice guy,” and you crank up the 
formal scientific method. 

For this you keep a lab notebook. Everything gets written down, formally, so that you know at all 
times where you are, where you’ve been, where you’re going and where you want to get. In scientific 
work and electronics technology this is necessary because otherwise the problems get so complex you get 
lost in them and confused and forget what you know and what you don’t know and have to give up. 
In cycle maintenance things are not that involved, but when confusion starts it’s a good idea to hold 
it down by making everything formal and exact. Sometimes just the act of writing down the problems 
straightens out your head as to what they really are. 

The logical statements entered into the notebook are broken down into six categories: (1) statement of 
the problem, (2) hypotheses as to the cause of the problem, (3) experiments designed to test each hypothesis, 
(4) predicted results of the experiments, (5) observed results of the experiments, and (6) conclusions from 
the results of the experiments. This is not different from the formal arrangement of many college and high- 
school lab notebooks but the purpose here is no longer just busywork. The purpose now is precise guidance of 
thoughts that will fail if they are not accurate. 

The real purpose of scientific method is to make sure Nature hasn’t misled you into thinking you 
know something you don’t actually know. There’s not a mechanic or scientist or technician alive who 
hasn’t suffered from that one so much that he’s not instinctively on guard. That’s the main reason why 


A motorcycle mechanic... so much scientific and mechanical information sounds so dull and so cautious. If you get careless or go 
who honks the horn to see if romanticizing scientific information, giving it a flourish here and there, Nature will soon make a com- 
the battery works is informally plete fool out of you. It does it often enough anyway even when you don’t give it opportunities. One 


conducting a true scientific 
experiment. He is testing a 
hypothesis by putting the 
question to nature. indefinitely. 

— Robert M. Pirsig In Part One of formal scientific 


method, which is the statement of the 


must be extremely careful and rigidly logical when dealing with Nature: one logical slip and an entire 
scientific edifice comes tumbling down. One false deduction about the machine and you can get hung up 


problem, the main skill is in stating 
absolutely no more than you are posi- 
tive you know. It is much better to 
enter a statement “Solve Problem: 
Why doesn’t cycle work?” which 
sounds dumb but is correct, than it 
is to enter a statement “Solve Prob- 
lem: What is wrong with the electrical 
system?” when you don’t absolutely 
know the trouble is in the electri- 
cal system. What you should state 
is “Solve Problem: What is wrong 
with cycle?” and then state as the 
first entry of Part Two: “Hypoth- 
esis Number One: The trouble is in 
the electrical system.” You think of 
as many hypotheses as you can, then 
you design experiments to test them 
to see which are true and which are 


false. 
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This careful approach to the beginning questions keeps you from taking a major wrong turn which might 
cause you weeks of extra work or can even hang you up completely. Scientific questions often have a surface 
appearance of dumbness for this reason. They are asked in order to prevent dumb mistakes later on. 

Part Three, that part of formal scientific method called experimentation, is sometimes thought of by 
romantics as all of science itself because that’s the only part with much visual surface. They see lots of test 
tubes and bizarre equipment and people running around making discoveries. They do not see the experi- 
ment as part of a larger intellectual process and so they often confuse experiments with demonstrations, 
which look the same. A man conducting a gee-whiz science show with fifty thousand dollars’ worth of 
Frankenstein equipment is not doing anything scientific if he knows beforehand what the results of his efforts 
are going to be. A motorcycle mechanic, on the other hand, who honks the horn to see if the battery works 
is informally conducting a true scientific experiment. He is testing a hypothesis by putting the question to 
nature. The TV scientist who mutters sadly, “The experiment is a failure; we have failed to achieve what 
we had hoped for,” is suffering mainly from a bad scriptwriter. An experiment is never a failure solely 
because it fails to achieve predicted results. An experiment is a failure only when it also fails adequately to 
test the hypothesis in question, when the data it produces don’t prove anything one way or another. 

Skill at this point consists of using experiments that test only the hypothesis in question, nothing less, 
nothing more. If the horn honks, and the mechanic concludes that the whole electrical system is working, he 
is in deep trouble. He has reached an illogical conclusion. The honking horn only tells him that the battery 
and horn are working. To design an experiment properly he has to think very rigidly in terms of what directly 
causes what. This you know from the hierarchy. The horn doesn’t make the cycle go. Neither does the bat- 
tery, except in a very indirect way. The point at which the electrical system directly causes the engine to_fire 
is at the spark plugs, and if you don’t test here, at the output of the electrical system, you will never really 
know whether the failure is electrical or not. 

To test properly the mechanic removes the plug and lays it against the engine so that the base around 
the plug is electrically grounded, kicks the starter lever and watches the spark-plug gap for a blue spark. If 
there isn’t any he can conclude one of two things: (a) there is an electrical failure or (b) his experiment is 
sloppy. If he is experienced he will try it a few more times, checking connections, trying every way he can 
think of to get that plug to fire. Then, if he can’t get it to fire, he finally concludes that (a) is correct, there’s 
an electrical failure, and the experiment is over. He has proved that his hypothesis is correct. 

In the final category, conclusions, skill comes in stating no more than the experiment has proved. It 
hasn’t proved that when he fixes the electrical system the motorcycle will start. There may be other things 
wrong. But he does know that the motorcycle isn’t going to run until the electrical system is working and 
he sets up the next formal question: “Solve problem: What is wrong with the electrical system?” 

He then sets up hypotheses for these and tests them. By asking the right questions and choosing 
the right tests and drawing the right conclusions the mechanic works his way down the echelons of the 
motorcycle hierarchy until he has found the exact specific cause or causes of the engine failure, and then he 
changes them so that they no longer cause the failure. 

An untrained observer will see only physical labor and often get the idea that physical labor is mainly 
what the mechanic does. Actually the physical labor is the smallest and easiest part of what the mechanic 
does. By far the greatest part of his work is careful observation and precise thinking. That is why mechan- 
ics sometimes seem so taciturn and withdrawn when performing tests. They don’t like it when you talk 
to them because they are concentrating on mental images, hierarchies, and not really looking at you or the 
physical motorcycle at all. They are using the experiment as part of a program to expand their hierarchy of 
knowledge of the faulty motorcycle and compare it to the correct hierarchy in their mind. They are looking 
at underlying form.” 


Practical Value of Theories 


As the above excerpt makes evident, theories allow us to generalize beyond individual facts or 
isolated situations. Theories provide a framework that can guide managerial strategy by providing 
insights into general rules of behavior. When different incidents may be theoretically comparable in 
some way, the scientific knowledge gained from theory development may have practical value. A 
good theory allows us to generalize beyond individual facts so that general patterns may be under- 
stood and predicted. For this reason it is often said there is nothing so practical as a good theory. 
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e Theories are only relevant to research because they are use- - The scientific method provides 5 
ful. In that sense, nothing could be “too theoretical.” a way of testing theoretical 
e Theories often guide research by providing a starting propositions. 
place, indicating what things should be observed, and e Managerial business strategy then becomes 
showing how these things should relate. guided by the theories that are verified 
e Theories become corroborated over time through testing through research. 
the explanations they offer. e All theories stand to be further tested, confirmed, 
- An empirical test means the theory must be compared modified, or proved to be incorrect. 
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to reality. The more that the explanations offered 
match reality the more the theory becomes verified. 


Summary 


1. Define the meaning of theory. Theories are simply models designed to help us better under- 
stand reality and to understand the logic behind things we observe. A theory is a formal, logical 
explanation of some events that includes predictions of how things relate to one another. 


2. Understand the goals of theory. There are two primary goals of theory. The first is to under- 
stand the relationships among various phenomena. A theory provides a picture of the linkages 
among different concepts, allowing us to better comprehend how they affect one another. The 
second goal is to predict. Once we have an understanding of the relationships among concepts, 
we can then predict what will happen if we change one factor. For example, if we understand 
the relationship between advertising expenditures and retail sales, we can then predict the impact 
of decreasing or increasing our advertising expenditures. 


3. Understand the terms concepts, propositions, variables, and hypotheses. A concept or construct 
is a generalized idea about a class of objects, attributes, occurrences, or processes that has been 
given a name. Leadership style, employee turnover, and customer satisfaction are all concepts. 
Concepts express in words various events or objects. Propositions are statements concerned 
with the relationships among concepts. A proposition explains the logical linkage among certain 
concepts by asserting a universal connection between concepts: “Leadership style is related to 
employee turnover.” A hypothesis is a formal statement explaining some outcome regarding 
variables of interest. Variables are the empirical reflection of a concept and a hypothesis is a 
proposition stated in a testable format. So, concepts and propositions are at the abstract level, 
while variables and hypotheses are at the empirical level. 


4. Discuss how theories are developed. A theory can be built through a process of review- 
ing previous findings of similar studies or knowledge of applicable theoretical areas. A theory 
may be developed with deductive reasoning by going from a general statement to a specific 
assertion. Deductive reasoning is the logical process of deriving a conclusion about a specific 
instance based on a known general premise or something known to be true. Inductive reason- 
ing is the logical process of establishing a general proposition on the basis of observation of 
particular facts. 


5. Understand the scientific method. The scientific method is a set of prescribed procedures for 
establishing and connecting theoretical statements about events, for analyzing empirical evidence, 
and for predicting events yet unknown. It is useful to look at the analytic process of scientific 
theory building as a series of stages. We mentioned seven operations may be viewed as the steps 
involved in the application of the scientific method: (1) Assessment of relevant existing knowl- 
edge of a phenomenon, (2) formulation of concepts and propositions, (3) statement of hypoth- 
eses, (4) design of research to test the hypotheses, (5) acquisition of meaningful empirical data, 
(6) analysis and evaluation of data, and (7) proposal of an explanation of the phenomenon and 
statement of new problems raised by the research. In sum, the scientific method guides us from 
the abstract nature of concepts and propositions, to the empirical variables and hypotheses, and 
to the testing and verification of theory. 
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Key Terms and Concepts 


abstract level, 40 hypothesis, 42 

concept (or construct), 40 inductive reasoning, 44 
deductive reasoning, 44 ladder of abstraction, 40 
empirical level, 40 latent construct, 41 
empirical testing, 42 operationalizing, 42 


propositions, 42 
scientific method, 45 
theory, 39 

variables, 42 


Questions for Review and Critical Thinking 


1. What are some theories offered to explain aspects of your field 


of business? 
2. How do propositions and hypotheses differ? 6. 
3. How do concepts differ from variables? 
4. What does the statement “There is nothing so practical as a T: 


good theory” mean? Do you agree with this statement? 
5. The seventeenth-century Dutch philosopher Benedict Spinoza 
said, “If the facts conflict with a theory, either the theory must 


Research Activities 


1. ‘NET The Chapter Vignette briefly introduced Attribution 
Theory. Do a Web search regarding Attribution Theory and 


identify the key characteristics of this theory. 3. 


2. ‘NET The Merriam-Webster dictionary definition of theory can be 
found at http://www.merriam-webster.com/dictionary/theory. What 


be changed or the facts.” What is the practical meaning of this 
statement? 

Compare and contrast deductive logic with inductive logic. Give an 
example of both. 

Find another definition of theory. How is the definition you 
found similar to this book’s definition? How is it different? 


is the definition of theory given at this site? How does it com- 
pare to the definition given in this chapter? 

'NET The Logic of Scientific Discovery is an important theoretical 
work. Visit The Karl Popper Web site at http://elm.eeng.dcu. 
ie/~tkpw/ to learn about its author and his work. 


CHAPTER 4 
THE BUSINESS 
RESEARCH 
PROCESS: 

AN OVE RVI EW After studying this chapter, you should be able to 


1. Define decision making and understand the role research 
plays in making decisions 

2. Classify business research as either exploratory research, 
descriptive research, or causal research 

3. List the major phases of the research process and the 
steps within each 

4. Explain the difference between a research project and a 
research program 


Chapter Vignette: The Changing 
Educational Environment 


Students seeking a higher education today enjoy many more choices than did their parents. 
Universities offer new degree programs in varied and specific fields including areas like sports mar- 
keting and gaming management. However, it isn't simply the fields of study that may be new, but 
also the manner of study. Options for nontraditional students who have difficulty attending day 
classes or devoting years of study to obtaining a degree have grown exponentially. The University 
of Phoenix, Strayer University, and Nova Southeast typify institu- 
tions that specialize in catering to 
those seeking a nontraditional 
degree program. These com- 
petitive pressures have led even 
the most traditional universi- 
ties to rethink the “sage on the 
stage” approach and conven- 
tional academic calendars. 

The market for the MBA 
degree is particularly competitive. 
Students pursue their MBA either 
traditionally, in weekend-only pro- 
grams, at night school, online, or in 
some combination. Over a quarter 
of a million U.S. students alone 
attend MBA classes of one form or 
another at any given time. In urban 
areas, such as the Dallas-Fort Worth 
area, there are sometimes a dozen 
or more institutions offering an MBA. 
Even in smaller communities, univer- 
sities are facing decisions about their 
MBA offerings as the competitive set and nontraditional programs have entered the market: 
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e How much should they adapt to the changing environment? 

e Should they offer courses online? 

e If so, who are they competing with? 

e Should they offer a weekend program? 

e Should they offer classes in multiple locations? 

e Can they better accomplish the mission of the university with an online MBA program? 
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e If multiple formats and locations are offered in the program, should different faculty teach? 

e Is demand sufficient? That is, are there enough potential students to make this financially feasible? 

e Is there a potential perceived product quality difference between a traditional and a nontraditional 
MBA program? 


The competitive MBA market typifies the landscape of many organizations. Clearly, universities 
could benefit from business research addressing some of these key questions. Each university main- 
tains its own academic standard while still trying to attract enough students to make its MBA program 
feasible. The competitive landscape is filled with both potential opportunities and potential problems. 
Decisions made by university administrators will determine how successfully each school deals with 
the changing environment. 
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Introduction 


This chapter focuses on the relationship between business research and managerial decision mak- 
ing. Business success is determined directly by the quality of decisions made by key personnel. 
Researchers contribute to decision making in several key ways. These include 


Helping to better define the current situation 

Defining the firm—determining how consumers, competitors, and employees view the firm 
Providing ideas for enhancing current business practices 

Identifying new strategic directions 

Testing ideas that will assist in implementing business strategies for the firm 


OR Oa 


Examining how correct a certain business theory is in a given situation 


The chapter introduces the types of research that allow researchers to provide input to key 
decision makers. Causality and the conditions for establishing causality are presented. Last but 
not least, the chapter discusses stages in the business research process. 


Decision Making 


Young adults make many decisions that affect their future. These include important strategic 
decisions like whether to go to college or not. If the answer is yes, then an individual faces a deci- 
sion regarding where to attend. Furthermore, the student must decide what subject to major in, 
what electives to take, which instructors to sign up for, whether or not to belong to a fraternity 
or sorority, how much to work outside of school, and so forth. The student may seek out data, 
usually in the form of advice provided by parents, guidance counselors, other students, or vari- 
ous media sources. These data may be critical in reaching decisions. Indeed, the answers to each 
of these questions shape a student’s future, influence the way he or she is viewed by others, and 
ultimately determine how successful he or she will be. 

Likewise, businesses face decisions that shape the future of the organization, its employees, and 
its customers. In each case, the decisions are brought about as the firm either seeks to capitalize on 
some opportunity or to reduce any potential negative impacts related to some business problem. A 
business opportunity is a situation that makes some potential competitive advantage possible. The 
discovery of some underserved segment presents such an opportunity. For example, eBay capital- 
ized on a business opportunity presented by technological advances to do much the same thing 
that is done at a garage sale but on a very, very large scale. 

A business problem is a situation that makes some significant negative consequence more 
likely. A natural disaster can present a problem for many firms as they face potential loss of prop- 
erty and personnel and the possibility that their operations, and therefore their revenue, will be 
interrupted. Most business problems, however, are not nearly as obvious. In fact, many are not 
easily observable. Instead, problems are commonly inferred from symptoms, which are observ- 
able cues that serve as a signal of a problem because they are caused by that problem. An increase 
in employee turnover is generally only a symptom of a business problem, rather than the prob- 
lem itself: Research may help identify what is causing this symptom so that decision makers can 


business opportunity 


A situation that makes some 
potential competitive advantage 
possible. 


business problem 


A situation that makes some 
significant negative consequence 
more likely. 


symptoms 


Observable cues that serve as a 
signal of a problem because they 
are caused by that problem. 
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Worthwhile 
° O° [9] 
Lonely 


© © © 


COURTESY OF QUALTRICS.COM 


Review the online survey we are using for this 

course. Based on the data that the survey gath- 

ers, what business problems or opportunities do 

you feel can be addressed from the information? 

Specify at least three research questions that can 

be answered by the information gathered by this 

survey. Do you think this survey is most representative of an 
exploratory research, descriptive research, or causal research 
design? Justify your answer. 


Useless 
° ° (0) [0] 
Friendly 
© (0) © © 
@ internet Qi 


decision making 


The process of developing and 
deciding among alternative 

ways of resolving a problem or 
choosing from among alternative 
opportunities. 


Can you identify symptoms that 
may indicate problems for these 
businesses? What business 
problems might they signify? 


52 


actually attack the problem, not just the symptom. Patients don’t usually go to the doctor and 
point out their problem (such as an ulcer). Instead, they point out the symptoms (upset stomach) 
they are experiencing. Similarly, decision makers usually hear about symptoms and often need 
help from research to identify and attack problems. Whether facing an opportunity or a problem, 
businesses need quality information to deal effectively with these situations. 

Formally defined, decision making is the process of developing and deciding among alterna- 
tive ways of resolving a problem or choosing from among alternative opportunities. A decision 
maker must recognize the nature of the problem or opportunity, identify how much information 
is currently available, how reliable it is, and determine what additional information is needed to 
better deal with the situation. Every decision-making situation can be classified based on whether 
it best represents a problem or an opportunity and where the situation falls on a continuum from 
absolute ambiguity to complete certainty. 


Certainty 


Complete certainty means that the decision maker has all information needed to make an opti- 
mal decision. This includes the exact nature of the business problem or opportunity. For exam- 
ple, an advertising agency may need to know the demographic characteristics of subscribers to 
magazines in which it may place a 
client’s advertisements. The agency 
knows exactly what information it 
needs and where to find the infor- 
mation. If a manager is completely 
certain about both the problem or 
opportunity and future outcomes, 
then research may not be needed 
at all. However, perfect certainty, 
especially about the future, is rare. 


ied, Uncertainty 


el) 

{ 
| | Uncertainty means that the manager 
m grasps the general nature of desired 


= 
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objectives, but the information about 
alternatives is incomplete. Predic- 
tions about forces that shape future 
events are educated guesses. Under 
conditions of uncertainty, effective 
managers recognize that spending 
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additional time to gather data that clarify the nature of a decision is needed. For instance, a uni- 
versity may understand that there is an objective of increasing the number of MBA students, but it 
may not know whether an online, weekend, or off-site MBA program is the best way to accom- 
plish the objective. Or a firm needing operating capital may consider an initial public offering, but 
is not certain of demand for the stock or how to establish the price of the IPO. Business decisions 
generally involve uncertainty, particularly when a company is seeking new opportunities. 


Ambiguity 


Ambiguity means that the nature of the problem itself is unclear. Objectives are vague and deci- 
sion alternatives are difficult to define. This is by far the most difficult decision situation, but 
perhaps the most common. 

Managers face a variety of problems and decisions. Complete certainty and predictable future 
outcomes may make business research a waste of time. However, under conditions of uncertainty 
or ambiguity, business research becomes more attractive to the decision makers. Decisions also 
vary in terms of importance, meaning that some may have great impact on the welfare of the firm 
and others may have negligible impact. The more important, ambiguous, or uncertain a situation 
is, the more likely it is that additional time must be spent on business research. 


PROBLEMS AND OPPORTUNITIES 


Exhibit 4.1 depicts decision situations characterized by the nature of the decision and the degree of 
ambiguity.' Under problem-focused decision making and conditions of high ambiguity, symptoms 
may not clearly point to some problem. Indeed, they may be quite vague or subtle, indicating only 
small deviations from normal conditions. For instance, a fast-food restaurant may be experiencing 
small changes in the sales of its individual products, but no change in overall sales. Such a symptom 


Discovery Orientation Confirmatory Orientation 


Trends seem evident 
but do not point clearly 
to a single best 
Opportunity 


Trends more obviously 
point to a single best 
opportunity 


Symptoms exist, but 
are subtle and few, 
making problem 
identification difficult 


Many noticable 
symptoms pointing 
to a single question 
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EXHIBIT 4.1 
Describing Decision-Making 
Situations 
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exploratory research 


Conducted to clarify ambigu- 
ous situations or discover ideas 
that may be potential business 

opportunities. 


Part 1: Introduction 


may not easily point to a problem such as a change in consumer tastes. As ambiguity is lessened, 
the symptoms are clearer and are better indicators of a problem. A large and sudden drop in overall 
sales may suggest the problem that the restaurant’s menu does not fare well compared to competi- 
tors’ menus. Thus, a menu change may be in order. However, it is also possible the drop in sales is 
due to new competition, a competitor’s price drop or new promotional campaign. Thus, research 
is needed to clarify the situation. 

Similarly, in opportunity-oriented research, ambiguity is characterized by environmental 
trends that do not suggest a clear direction. As the trends become larger and clearer, they are more 
diagnostic, meaning they point more clearly to a single opportunity. 


Types of Business Research 


Business research is undertaken to reduce uncertainty and focus decision making. In more ambig- 
uous circumstances, management may be totally unaware of a business problem. Alternatively, 
someone may be scanning the environment for opportunities. For example, an entrepreneur may 
have a personal interest in softball and baseball. She is interested in converting her hobby into a 
profitable business venture and hits on the idea of establishing an indoor softball and baseball train- 
ing facility and instructional center. However, the demand for such a business is unknown. Even 
if there is sufficient demand, she is not sure of the best location, actual services offered, desired 
hours of operation, and so forth. Some preliminary research is necessary to gain insights into the 
nature of such a situation. Without it, the situation may remain too ambiguous to make more than 
a seat-of-the-pants decision. In this situation, business research is almost certainly needed. 

In other situations, researchers know exactly what their problems are and can design careful 
studies to test specific hypotheses. For example, an organization may face a problem regarding 
health care benefits for their employees. Awareness of this problem could be based on input from 
human resource managers, recruiters, and current employees. The problem could be contributing 
to difficulties in recruiting new employees. How should the organization’s executive team address 
this problem? They may devise a careful test exploring which of three different health plans are 
judged the most desirable. This type of research is problem-oriented and seems relatively unam- 
biguous. This process may culminate with researchers preparing a report suggesting the relative 
effect of each alternative plan on employee recruitment. The selection of a new health plan should 
follow relatively directly from the research. 

Business research can be classified on the basis of either technique or purpose. Experiments, 
surveys, and observational studies are just a few common research techniques. Classifying research 
by its purpose, such as the situations described above, shows how the nature of a decision situation 
influences the research methodology. The following section introduces the three types of business 
research: 


1. Exploratory 
2. Descriptive 
3. Causal 


Matching the particular decision situation with the right type of research is important in obtaining 
useful research results. 


Exploratory Research 


Exploratory research is conducted to clarify ambiguous situations or discover potential business 
opportunities. As the name implies, exploratory research is not intended to provide conclusive evi- 
dence from which to determine a particular course of action. In this sense, exploratory research is 
not an end unto itself. Usually exploratory research is a first step, conducted with the expectation 
that additional research will be needed to provide more conclusive evidence. Exploratory research 
is often used to guide and refine these subsequent research efforts. The Research Snapshot on 
the next page illustrates a use of exploratory research. For example, rushing into detailed surveys 
before it is clear exactly what decisions need to be made can waste time, money, and effort by 
providing irrelevant information. This is a common mistake in business research programs. 
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A Cute, Funny, or Sexy? What 

Makes a Mascot Tick? 

Has the Pillsbury Doughboy ever 
changed? How old should the Brawny (paper 
towel) man be? What should the M&Ms characters 
be named? These questions all have many possible answers. In 
truth, a lot of research goes into answering these kinds of ques- 
tions. It often begins with exploratory research. For instance, 
focus groups involving female consumers revealed a consider- 
able amount of intimate discussion about the Brawny man. Thus, 
it seemed that a sexy Brawny man would yield a better response 
than a humorous or intelligent Brawny man. 

Mr. Peanut, the icon for Planter’s Peanuts, has actually 
changed very little since his introduction in the 1920s. He 
looks good for his age! Again, exploratory research suggests 
generally positive comments about Mr. Peanut, so only minor 


a Mr. Peanut in Bermuda shorts, but the tests proved over- 
whelmingly negative, sending Planters back to a more original 
peanut. 

Similarly, exploratory research simply asked a few consum- 
ers for their reactions to the Mars M&Ms characters. Mars was 
interested in discovering names for the characters. They found 
that most consumers simply referred to them by their colors. This 
piece of information became useful in shaping future research 
and business strategy. 


Sources: Voight, Joan, “Mascot 
Makeover: The Risky Business of 
Tampering with Brand Icons,” Adweek 
(July 7, 2003), 20-26; Elliot, Stuart, 
“Updating a Venerable Character, or 
Tarnishing a Sterling Reputation?” 
The New York Times (March 19, 2004), 
C5; “Advertising Mascots—People,” 
TV Acres, http://www.tvacres.com/ 


admascots_brawny.htm, accessed 
January 25, 2009. 


changes in the color scheme have been introduced. A few 
years ago, exploratory research led to some further tests of 


Exploratory research is particularly useful in new product development.* Sony and Honda have 
each been instrumental in developing robot technology.’ Making a functional robot that can move 
around, perform basic functions, carry out instructions, and even carry on a conversation isn’t really 
a problem. What Sony and Honda have to research is what business opportunities may exist based 
on robot technology. Exploratory research allowing consumers to interact with robots suggests that 
consumers are more engaged when the robot has human qualities, such as the ability to walk on 
two legs. Researchers noticed that people will actually talk to the robot (which can understand basic 
oral commands) more when it has human qualities. In addition, consumers do seem entertained by 
a walking, talking, dancing robot. These initial insights have allowed each company to form more 
specific research questions focusing on the relative value of a robot as an entertainment device or as 
a security guard, and identifying characteristics that may be important to consumers. 

In our university example, it could be that exploratory research is needed to help identify con- 
cerns about nontraditional course delivery for business classes. This exploratory research should 
include open-ended interviews with faculty, students, and alumni. By doing so, specific hypoth- 
eses can be developed that test the relative attractiveness of alternative curricula to students, the 
effect of online instruction on job satisfaction and on alumni quality perceptions.* These hypoth- 
eses may be tested by either, or both, of the remaining two research types. 


Descriptive Research 


As the name implies, the major purpose of descriptive research is to describe characteristics of 
objects, people, groups, organizations, or environments. In other words, descriptive research tries 
to “paint a picture” of a given situation by addressing who, what, when, where, and how questions. 
For example, every month the Bureau of Labor Statistics (BLS) conducts descriptive research 
in the form of the Current Population Survey. Official statistics on a variety of characteristics of 
the labor force are derived from this survey (the Current Population Survey can be found at 
http://www.bls.gov/CPS/). This research describes the who, what, when, where, and how regarding 
the current economic and employment situation. 

Unlike exploratory research, descriptive studies are conducted after the researcher has gained a 
firm grasp of the situation being studied. This understanding, which may have been developed in 
part from exploratory research, directs the study toward specific issues. Later, we will discuss the role 
of research questions and hypotheses. These statements help greatly in designing and implementing 
a descriptive study. Without these, the researcher would have little or no idea of what questions to 
ask. The Research Snapshot on the next page illustrates an application of descriptive research. 


descriptive research 


Describes characteristics of 
objects, people, groups, organi- 
zations, or environments; tries 
to “paint a picture” of a given 
situation. 


55 


PR NEWSPHOTOL/GEORGIA PACIFIC 


© ROMAN SIGAEV/SHUTTERSTOCK 


© AP PHOTO/THE OAKLAND PRESS 


Whines for Wines 
Greg Norman is best known for performance on the golf course. 
However, he is also one of the most successful businesspeople to 
come out of sports. Among his many ventures, Norman is a well- 
respected vintner. Norman Estates gained fame in the wine trade 
with Australian wines that offered considerable quality at a fair 
price. More recently, Norman Estates is expanding its portfolio 
by purchasing vineyard properties and production capacity in 
California. As Norman Estates and other wineries consider diversi- 
fying production beyond their traditional boundaries, descriptive 
research can be vital in making these key decisions. 

Descriptive research details what wine consumers like 
to drink in terms of where the wine is from and where the 
consumers are located. Consumers around the world form 
geographic segments with 
preferences for wines from 
certain areas. American con- 
sumers, for instance, have 
contributed to the growing 


slump in French wine sales by switch- 
ing increasingly from French wines to 
Australian- and American-made wines. In 
particular, French wines at low and moder- 
ate prices have suffered, whereas higher 


price French wine sales remain steady. In addi- 
tion, wine sales in the United States and in the United Kingdom 
are relatively strong compared to wine sales in France and 


Germany. 


All of these descriptive results may allow Greg Norman a bet- 
ter understanding of the international wine market and therefore 
make better decisions about where to grow and produce wine. 
Do you think the choice to expand to California rather than 
France seems like a good decision? 


Sources: Orth, U. R., M. M. Wolf, and T. Dodd, “Dimensions of Wine Region 

Equity and Their Impact on Consumer Preferences,” Journal of Product and Brand 
Management 14, no. 2 (2005), 88-97; Conibear, Helena, “World-Wide Consumption 
Trends,” AlM-Digest (2005), http://www.aim-digest.com/gateway/pages/trends/ 
articles/trends.htm, accessed November 24, 2005. 


Descriptive research often helps describe market segments. For example, researchers used 


descriptive surveys to describe consumers who are heavy consumers (buy a lot) of organic food 


products. The resulting report showed that these consumers tend to live in coastal cities with 
populations over 500,000, with the majority residing on the West Coast. The most frequent 
buyers of organic foods are affluent men and women ages 45—54 (36 percent) and 18—34 (35 per- 
cent). Interestingly, consumers who buy organic foods are not very brand-oriented—81 percent 


of them cannot name a single organic brand. Research such as this helps high-quality supermar- 
kets such as Whole Foods make location decisions. Over half of Whole Foods’ food products 


Descriptive research about 


; are organic. 
consumers who buy organic S OTeanIe 


food has paid off for the Whole Similarly, the university considering the addition of an online MBA program might benefit 


Foods chain of stores. 
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from descriptive research profil- 
ing the current and the potential 
customers. Online customers are 
not identical to the traditional 
MBA student. They tend to be 
older than the average 24-year- 
old traditional student, averaging 
about 30 years of age. Also, they 
tend to live in rural communi- 
ties, be more introverted, and 
expect a higher workload than 
traditional students. Another key 
statistic is that the dropout rate 
for online students is significantly 
higher than for traditional MBA 
students. Nearly 14 percent of 
online students drop before com- 
pleting a course as compared to 
7.2 percent for traditional in-class 
students. For this and other rea- 
sons, online students are much 
more costly to serve.° 
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Accuracy is critically important in descriptive research. If a descriptive study incorrectly 
estimates a university’s demand for its MBA offering by even a few students, it can mean the 
difference between the program sustaining itself or being a drain on already scarce resources. 
For instance, if a cohort group of 25 students is predicted, but only 15 students actually 
sign up, the program will likely not generate enough revenue to sustain itself. Therefore, 
it is easy to see that descriptive research forecasting sales revenue and costs or describing 
consumer attitudes, satisfaction, and commitment must be accurate or decision making will 
suffer. 

Survey research typifies a descriptive study. For example, state societies of certified public 
accountants (CPAs) conduct annual practice management surveys that ask questions such as “Do 
you charge clients for travel time at regular rates?” “Do you have a program of continuing edu- 
cation on a regular basis for professional employees?” “Do you pay incentive bonuses to profes- 
sional staff?” Although the researcher may have a general understanding of the business practices 
of CPAs, conclusive evidence in the form of answers to questions of fact must be collected to 
determine the actual activities. 

A diagnostic analysis seeks to diagnose reasons for business outcomes and focuses spe- 
cifically on the beliefs and feelings respondents have about and toward specific issues. A 
research study trying to diagnose slumping French wine sales might ask consumers their 
beliefs about the taste of French, Australian, and American wines. The results might indicate 
a deficiency in taste, suggesting that consumers do not believe French wines taste as fruity 
as do the others. Descriptive research can sometimes provide an explanation by diagnosing 
differences among competitors, but descriptive research does not provide direct evidence 
of causality. 


Causal Research 


Ifa decision maker knows what causes important outcomes like sales, stock price, and employee 
satisfaction, then he or she can shape firm decisions in a positive way. Causal inferences are 
very powerful because they lead to greater control. Causal research seeks to identify cause- 
and-effect relationships. When something causes an effect, it means it brings it about or makes 
it happen. The effect is the outcome. Rain causes grass to get wet. Rain is the cause and wet 
grass is the effect. 

The different types of research discussed here are often building blocks—exploratory research 
builds the foundation for descriptive research, which usually establishes the basis for causal research. 
Thus, before causal studies are undertaken, researchers typically have a good understanding of the 
phenomena being studied. Because of this, the researcher can make an educated prediction about 
the cause-and-effect relationships that will be tested. Although greater knowledge of the situation 
is a good thing, it doesn’t come without a price. Causal research designs can take a long time to 
implement. Also, they often involve intricate designs that can be very expensive. Even though 
managers may often want the assurance that causal inferences can bring, they are not always will- 
ing to spend the time and money it takes to get them. 


CAUSALITY 


Ideally, managers want to know how a change in one event will change another event of inter- 
est. As an example, how will implementing a new employee training program change job per- 
formance? Causal research attempts to establish that when we do one thing, another thing will 
follow. A causal inference is just such a conclusion. While we use the term “cause” frequently 
in our everyday language, scientifically establishing something as a cause is not so easy. A causal 
inference can only be supported when very specific evidence exists. Three critical pieces of causal 
evidence are: 


1. Temporal Sequence 
2. Concomitant Variance 
3. Nonspurious Association 
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diagnostic analysis 


Seeks to diagnose reasons for 
business outcomes and focuses 
specifically on the beliefs and 
feelings consumers have about 
and toward competing products. 


causal research 


Allows causal inferences to be 
made; seeks to identify cause- 
and-effect relationships. 


causal inference 


A conclusion that when one 
thing happens, another specific 
thing will follow. 
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temporal sequence 


One of three criteria for causal- 
ity; deals with the time order of 
events—the cause must occur 

before the effect. 


concomitant variation 


One of three criteria for causality; 
occurs when two events “covary,” 
meaning they vary systematically. 


nonspurious association 


One of three criteria for causality; 
means any covariation between 
a cause and an effect is true and 

not simply due to some other 
variable. 


Part 1: Introduction 


Temporal Sequence 

Temporal sequence deals with the time order of events. In other words, having an appropriate causal 
order of events, or temporal sequence, is one criterion for causality. Simply put, the cause must 
occur before the effect. It would be difficult for a restaurant manager to blame a decrease in sales 
on a new chef if the drop in sales occurred before the new chef arrived. If a change in the CEO 
causes a change in stock prices, the CEO change must occur before the change in stock values. 


Concomitant Variation 

Concomitant variation occurs when two events “covary” or “correlate,” meaning they vary systemat- 
ically. In causal terms, concomitant variation means that when a change in the cause occurs, a change 
in the outcome also is observed. A correlation coefficient, which we discuss in a later chapter, is often 
used to represent concomitant variation. Causality cannot possibly exist when there is no systematic 
variation between the variables. For example, if a retail store never changes its employees’ vacation 
policy, then the vacation policy cannot possibly be responsible for a change in employee satisfaction. 
There is no correlation between the two events. On the other hand, if two events vary together, one 
event may be causing the other. If a university increases its number of online MBA course offerings 
and experiences a decrease in enrollment in its traditional in-class MBA offerings, the online course 
offerings may be causing the decrease. But the systematic variation alone doesn’t guarantee it. 


Nonspurious Association 
Nonspurious association means any covariation between a cause and an effect is true, rather than 
due to some other variable. A spurious association is one that is not true. Often, a causal infer- 
ence cannot be made even though the other two conditions exist because both the cause and 
effect have some common cause; that is, both may be influenced by a third variable. For instance, 
there is a strong, positive correlation between ice cream purchases and murder rates—as ice cream 
purchases increase, so do murder rates.’ When ice cream sales decline, murder rates also drop. Do 
people become murderers after eating ice cream? Should we outlaw the sale of ice cream? This 
would be silly because the concomitant variation observed between ice cream consumption and 
murder rates is spurious. A third variable is actually important here. People purchase more ice 
cream when the weather is hot. People are also more active and likely to commit a violent crime 
when it is hot. The weather, being associated with both may actually cause both. Exhibit 4.2 
illustrates the concept of spurious association. 

Establishing evidence of nonspuriousness can be difficult. If a researcher finds a third vari- 
able that is related to both the cause and effect, which causes a significant drop in the correlation 


"4.2 The Spurious Effect of Ice Cream 


Proposed Causal Inference 


— Se 


Spurious Association 
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between the cause and effect, then a causal inference becomes difficult to support. Although 
the researcher would like to rule out the possibility of any alternative causes, it is impossible to 
observe the effect of every variable on the correlation between the cause and effect. Therefore, 
the researcher must use logic, or a theory, to identify the most likely “third” variables that would 
relate significantly to both the cause and effect. The researcher must control for these variables 
in some way. In addition, the researcher should use theory to make sure the assumed cause-and- 
effect relationship truly makes sense. 
In summary, causal research should do all of the following: 


1. Establish the appropriate causal order or sequence of events 
Measure the concomitant variation between the presumed cause and the presumed effect 

3. Examine the possibility of spuriousness by considering the presence of alternative plausible 
causal factors 


DEGREES OF CAUSALITY 


In everyday language, we often use the word “cause” in an absolute sense. For example, a warning 
label used on cigarette packages claims “smoking causes cancer.” Is this true in an absolute sense? 
Absolute causality means the cause is necessary and sufficient to bring about the effect. Thus, if 
we find only one smoker who does not eventually get cancer, the claim is false. Although this 
is a very strong inference, it is impractical to think that we can establish absolute causality in the 
behavioral sciences. 

Why do we continue to do causal research then? Well, although managers may like to be able 
to draw absolute conclusions, they can often make very good decisions based on less powerful 
inferences. Conditional causality means that a cause is necessary but not sufficient to bring about an 
effect. This is a weaker causal inference. One way to think about conditional causality is that the 
cause can bring about the effect, but it cannot do so alone. If other conditions are right, the cause 
can bring about the effect. We know there are other medical factors that contribute to cancer. For 
instance, genetics, lifestyle, and diet are also plausible causes of cancer. Thus, if one smokes and 
has a genetic disposition, diet, and lifestyle that promote cancer, smoking could be considered a 
conditional cause of cancer. However, if we can find someone who has contracted cancer and 
never smoked, the causal inference would be proven wrong. 

Contributory causality is the weakest form of causality, but it is still a useful concept. A cause need 
be neither necessary nor sufficient to bring about an effect. However, causal evidence can be estab- 
lished using the three factors discussed. For any outcome, there may be multiple causes. So, an event 
can be a contributory cause of something so long as the introduction of the other possible causes does 
not eliminate the correlation between it and the effect. This will become clearer when we discuss 
ways to test relationships later in the text. Smoking then can be a contributory cause of cancer so 
long as the introduction of other possible causes does not cause both smoking and cancer. 


EXPERIMENTS 


Business experiments hold the greatest potential for establishing cause-and-effect relationships. An 
experiment is a carefully controlled study in which the researcher manipulates a proposed cause 
and observes any corresponding change in the proposed effect. An experimental variable rep- 
resents the proposed cause and is controlled by the researcher by manipulating it. Manipulation 
means that the researcher alters the level of the variable in specific increments. 

For example, consider a manager who needs to make decisions about the price and distribution 
of a new video game called the Wee Box. She understands that both the price level and the type 
of retail outlet in which the product is placed are potential causes of sales. A study can be designed 
which manipulates both the price and distribution. The price can be manipulated by offering it for 
$100 among some consumers and $200 among others. Retail distribution may be manipulated by 
selling the Wee Box at discount stores in some consumer markets and at specialty electronics stores 
in others. The retailer can examine whether price and distribution cause sales by comparing the sales 
results in each of the four conditions created. Exhibit 4.3 on the next page illustrates this study. 

An experiment like the one described above may take place in a test-market. Test-marketing 
is a frequently used form of business experimentation. A test-market is an experiment that is 
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absolute causality 


Means the cause is necessary 
and sufficient to bring about the 
effect. 


conditional causality 


Means that a cause is necessary 
but not sufficient to bring about 
an effect. 


contributory causality 


Means that a cause need be nei- 
ther necessary nor sufficient to 
bring about an effect. 


experiment 


A carefully controlled study in 
which the researcher manipu- 
lates a proposed cause and 
observes any corresponding 
change in the proposed effect. 


experimental variable 


Represents the proposed 
cause and is controlled by the 
researcher by manipulating it. 


manipulation 


Means that the researcher alters 
the level of the variable in spe- 
cific increments. 


test-market 


An experiment that is conducted 
within actual market conditions. 
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Testing for Causes with an 
Experiment 


Wee Box Sales by Condition 


High Price Low Price 


Des Moines, lowa: 
Retail Price: $100 
Retail Store: Best Buy 


Peoria, Illinois: 
Retail Price: $200 
Retail Store: Best Buy 


Specialty Distribution 


St. Louis, Missouri: 
Retail Price $200 
Retail Store: Big Cheap-Mart 


General Distribution Kansas City, Missouri: 
Retail Price: $100 


Retail Store: Big Cheap-Mart 


Assuming that Wee Box consumers are the same in each of these cities, the extent to which price and 
distribution cause sales can be examined by comparing the sales results in each of these 4 conditions. 


conducted within actual business conditions. McDonald’s restaurants have a long-standing tradi- 
tion of test-marketing new product concepts by introducing them at selected stores and moni- 
toring sales and customer feedback. Recently, McDonald’s extensively test-marketed McCafé 
specialty coffees and beverages. These products were sold at a group of McDonald’s outlets and 
feedback was used to refine the offering including the size of the cups, prices, and what types of 
extras to add to the drink (including sprinkles of chocolate, whipped cream, steamed milk, and 
chocolate, vanilla, and caramel shots). McDonald’s could then monitor the effect on overall sales, 
as well as cannibalization of regular coffee sales, in a real-world setting. Earlier, McDonald’s had 
test-marketed Wi-Fi service in some outlets. Three different rival Wi-Fi service providers (the 
manipulation) were used in different locations and the cost, service, and customer feedback were 
used to select the best provider for use in McDonald’s restaurants. 

Most basic scientific studies in business (for example, the development of theories about 
employee motivation or consumer behavior) ultimately seek to identify cause-and-effect relation- 
ships. In fact, we often associate science with experiments. To predict a relationship between, say, 
price and perceived quality of a product, causal studies often create statistical experiments with 
controls that establish contrast groups. 


Uncertainty Influences the Type of Research 


So, which form of research—exploratory, descriptive, or causal—is appropriate for the current 
situation? The most appropriate type and the amount of research needed are largely a function of 
how much uncertainty surrounds the situation motivating the research. Exhibit 4.4 contrasts the 


4 Characteristics of Different Types of Business Research 


Causal Research 


Exploratory Research 


Descriptive Research 


Amount of Uncertainty 
Characterizing Decision Situation 


Key Research Statement 
When Conducted? 
Usual Research Approach 


Examples 


Nature of Results 


Highly ambiguous 


Research question 
Early stage of decision making 
Unstructured 


“Our sales are declining for no 
apparent reason.” 


“What kinds of new products are 
fast-food customers interested in?” 


Discovery oriented, productive, 
but still speculative. Often in need 
of further research. 


Partially defined 


Research question 
Later stages of decision making 
Structured 


“What kind of people patronize 
our stores compared to our 
primary competitor?” 


“What product features are most 
important to our customers?” 


Can be confirmatory although 
more research is sometimes 
still needed. Results can be 
managerially actionable. 


Clearly defined 


Research hypothesis 
Later stages of decision making 
Highly Structured 


“Will consumers buy more 
products in a blue package?” 


“Which of two advertising 
campaigns will be more 
effective?” 


Confirmatory oriented. Fairly 
conclusive with managerially 
actionable results often obtained. 


Chapter 4: The Business Research Process: An Overview 


types of research and illustrates that exploratory research is conducted during the early stages of 
decision making. At this point, the decision situation is usually highly ambiguous and manage- 
ment is very uncertain about what actions should, or even could, be taken. When management is 
aware of the problem but lacks some knowledge, descriptive research is usually conducted. Causal 
research requires sharply defined problems. 

Each type of research also produces a different type of result. In many ways, exploratory 
research is the most productive since it should yield large numbers of ideas. It is part of the 
“domain of discovery,” and as such, unstructured approaches can be very successful. Too much 
structure in this type of research may lead to more narrowly focused types of responses that could 
stifle creativity. Thus, although it is productive, exploratory research results usually need further 
testing and evaluation before they can be made actionable. At times, however, managers do take 
action based only on exploratory research results. Sometimes, management may not be able or 
may not care to invest the time and resources needed to conduct further research. Decisions made 
based only on exploratory research can be more risky, since exploratory research does not test 
ideas among a scientific sample.* For instance, a business school professor may ask a class of current 
MBA students for ideas about an online program. Although the students may provide many ideas 
that sound very good, even the best of them has not been tested on a sample of potential online 
MBA students. 

Descriptive research is typically focused around one or more fairly specific research ques- 
tions. It is usually much more structured and, for many common types of business research, can 
yield managerially actionable results. For example, descriptive research is often used to profile a 
customer segment both demographically and psychographically. Results like this can greatly assist 
firms in deciding when and where to offer their goods or services for sale. 

Causal research is usually very focused around a small number of research hypotheses. 
Experimental methods require tight control of research procedures. Thus, causal research is highly 
structured to produce specific results. Causal research results are often managerially actionable 
since they suggest that if management changes the value of a “cause,” some desirable effect will 
come about. So, by changing the training program, the cause, an increase in employee productiv- 
ity, can result. 


Stages in the Research Process 


Business research, like other forms of scientific inquiry, involves a sequence of highly interrelated 
activities. The stages of the research process overlap continuously, and it is clearly an oversim- 
plification to state that every research project has exactly the same ordered sequence of activities. 
Nevertheless, business research often follows a general pattern. We offer the following research 
business stages: 


Defining the research objectives 

Planning a research design 

Planning a sample 

Collecting the data 

Analyzing the data 

Formulating the conclusions and preparing the report 


Or Ste YRS 


Exhibit 4.5 on the next page portrays these six stages as a cyclical or circular-flow process. The 
circular-flow concept is used because conclusions from research studies can generate new ideas 
and knowledge that can lead to further investigation. Thus, there is a dashed connection between 
conclusions and reporting and defining the research objectives. Notice also that management is in the 
center of the process. The research objectives cannot be properly defined without managerial 
input. After all, it is the manager who ultimately has to make the decision. It is also the manager 
who may ask for additional research once a report is given. 

In practice, the stages overlap somewhat from a timing perspective. Later stages sometimes 
can be completed before earlier ones. The terms forward linkage and backward linkage reflect the 
interrelationships between stages. Forward linkage implies that the earlier stages influence the later 
stages. Thus, the research objectives outlined in the first stage affect the sample selection and 
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forward linkage 


Implies that the earlier stages of 
the research process influence 
the later stages. 
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EXHIBIT 4.5 
Stages of the Research 
Process 


backward linkage 


Implies that later steps influence 
earlier stages of the research 
process. 


; ; ; the way data are collected. The sample selection question affects the wording of questionnaire 
Research is sometimes directly 


actionable. The results may also : . : . . : 
suggest ideas for new studies. questionnaire wording will be simpler than if the respondents were college graduates. 


items. For example, if the research concentrates on respondents with low educational levels, the 


Backward linkage implies that later steps influence earlier 
stages of the research process. If it is known that the data will 
be collected via e-mail, then the sampling must include those 
with e-mail access. A very important example of backward 
linkage is the knowledge that the executives who will read the 
research report are looking for specific information. The profes- 
sional researcher anticipates executives’ needs for information 
throughout the planning process, particularly during the analysis 
and reporting. 


Alternatives in the Research Process 


The researcher must choose among a number of alternatives dur- 
ing each stage of the research process. The research process can 
be compared to a map. It is important to remember that there 
is no single “right” path for all journeys. The road one takes 
depends on where one wants to go and the resources (money, 
time, labor, and so on) available for the trip. The map analogy is 
useful for the business researcher because there are several paths 
that can be followed at each stage. When there are severe time 
constraints, the quickest path may be most appropriate. When 
money and human resources are plentiful, more options are 
available and the appropriate path may be quite different. 
Chapter 1 introduced the research process. Here, we briefly 
describe the six stages of the research process. Later, each stage 
is discussed in greater depth. Exhibit 4.6 shows the decisions 
that researchers must make in each stage. This discussion of the 
research process begins with research objectives, because most 
research projects are initiated to remedy managers’ uncertainty 


about some aspect of the firm’s business program. 
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EXHIBIT 4.6 Flowchart of the Business Research Process 


Problem Discovery 


Samplin 
and Definition pling 


Data 
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Data 
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Planning the 
Research Design 


Drawing 
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Defining the Research Objectives 


Exhibit 4.6 shows that the research process begins with research objectives. Research objectives 
are the goals to be achieved by conducting research. In consulting, the term deliverables is often 
used to describe the objectives to a research client. The genesis of the research objectives lies in the 
type of decision situation faced. The objectives may involve exploring the possibilities of enter- 
ing a new market. Alternatively, they may involve testing the effect of some policy change on 
employee job satisfaction. Different types of objectives lead to different types of research designs. 

In applied business research, the objectives cannot really be determined until there is a clear 
understanding of the managerial decision to be made. This understanding must be shared between 
the actual decision maker and the lead researcher. We often describe this understanding as a prob- 
lem statement. In general usage, the word problem suggests that something has gone wrong. This 
isn’t always the case before research gets started. Actually, the research objective may be to simply 
clarify a situation, define an opportunity, or monitor and evaluate current business operations. The 
research objectives cannot be developed until managers and researchers have agreed on the actual 
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Note: Diamond-shaped boxes indicate stages in the research process in which a choice of one or more techniques must be made. The dotted line indicates 
an alternative path that skips exploratory research. 


research objectives 


The goals to be achieved by con- 
ducting research. 


deliverables 


The term used often in consult- 
ing to describe research objec- 
tives to a research client. 
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The library contains a wealth of 
information. Studies forming a 
literature review can be found 
in the library. 
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business “problem” that will be addressed by the research. Thus, they set out to “discover” this 
problem through a series of interviews and through a document called a research proposal. 

It should be noted that this process is oriented more toward discovery than confirmation or justi- 
fication. Managers and researchers alike may not have a clear-cut understanding of the situation at 
the outset of the research process. Managers may only be able to list symptoms that could indicate 
a problem. For example, employee turnover is increasing, but management may not know the 
exact nature of the problem. Thus, the problem statement often is made only in general terms; 
what is to be investigated is not yet specifically identified. 


DEFINING THE MANAGERIAL DECISION SITUATION 


In business research, the adage “a problem well defined is a problem half solved” is worth remem- 
bering. Similarly, Albert Einstein noted that “the formulation of a problem is often more essential 
than its solution.”” These phrases emphasize that an orderly definition of the research problem pro- 
vides direction to the investigation. Careful attention to problem definition allows the researcher 
to set the proper research objectives. When the purpose of the research is clear, the chances of 
collecting the necessary and relevant information, and not collecting surplus information, will be 
much greater. 

Managers often are more concerned with finding the right answer rather than asking the right 
question. They also want one solution quickly, rather than having to spend time considering 
many possible solutions. However, properly defining a problem can be more difficult than actually 
solving it. In business research, if data are collected before the nature of the problem is carefully 
thought out, they probably will not yield useful information. 

Thus, defining the decision situation must precede the research objectives. Frequently the 
researcher will not be involved until the management team has discovered that some informa- 
tion about a particular aspect of the business is needed. Even at this point the exact nature of the 
situation may be poorly defined. Once a problem area has been discovered, the researcher and 
management together can begin the process of precisely defining it. 

Much too often research is conducted without a clear definition of the objectives. Researchers 
forget that the best place to begin a research project is at the end. In other words, knowing what is 
to be accomplished determines the research process. An error or 
omission in specifying objectives is likely to be a costly mistake 
that cannot be corrected in later stages of the research process. 


EXPLORATORY RESEARCH 


Exploratory research can be used to help identify and clarify 
the decisions that need to be made. These preliminary research 
activities can narrow the scope of the research topic and help 
transform ambiguous problems into well-defined ones that 
yield specific research objectives. By investigating any existing 
studies on the subject, talking with knowledgeable individu- 
als, and informally investigating the situation, the researcher 
can progressively sharpen the focus of the research. After such 
exploration, the researcher should know exactly which data 
to collect during the formal phases of the project and how to 
conduct the project. Exhibit 4.6 indicates that managers and 
researchers must decide whether to use one or more explo- 
ratory research techniques. As Exhibit 4.6 indicates, this stage 
is optional. 

The business researcher can employ techniques from four 
basic categories to obtain insights and gain a clearer idea of the 
problem: previous research, pilot studies, case studies, and expe- 
rience surveys. These are discussed in detail in later chapters. 
This section will briefly discuss previous research and focus 
group interviews, the most popular type of pilot study. 
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Previous Research 

As a general rule, researchers should first investigate previous research to see whether or not 
others may have already addressed similar research problems. Initially, internal research reports 
should be searched within the company’s archives. In addition, some firms specialize in provid- 
ing various types of research reports, such as economic forecasts. The Census of Population and 
the Survey of Current Business are each examples of previous research conducted by an outside 
source. 

Previous research may also exist in the public domain. The first place researchers will 
likely look today is online. The Internet and modern electronic search engines available 
through most university libraries have made literature reviews simpler and faster to conduct. A 
literature review is a directed search of published works, including periodicals and books, that 
discusses theory and presents empirical results that are relevant to the topic at hand. While a 
literature survey is common in applied research studies, it is a fundamental requirement of a 
basic research report. 

Suppose, for example, that a bank is interested in determining the best site for additional auto- 
mated teller machines. A logical first step would be to investigate the factors that bankers in other 
parts of the country consider important. By reading articles in banking journals, management 
might quickly discover that the best locations are inside supermarkets located in residential areas 
where people are young, highly educated, and earning higher-than-average incomes. These data 
might lead the bank to investigate census information to determine where in the city such people 
live. Reviewing and building on the work already compiled by others is an economical starting 
point for most research. 


Pilot Studies 

Almost all consumers take a test drive before buying a car. A pilot study serves a similar purpose 
for the researcher. A pilot study is a small-scale research project that collects data from respondents 
similar to those that will be used in the full study. It can serve as a guide for a larger study or exam- 
ine specific aspects of the research to see if the selected procedures will actually work as intended. 
Pilot studies are critical in refining survey questions and reducing the risk that the full study will be 
fatally flawed. This is particularly true for experimental research, which depends critically on valid 
manipulations of experimental variables." Pilot studies also often are useful in fine-tuning research 
objectives. Pilot studies are sometimes referred to as pretests. A pretest is a very descriptive term 
indicating a small-scale study in which the results are preliminary and intended only to assist in 
design of a subsequent study. 

Focus group interviews are sometimes used as a pilot study. A focus group interview brings 
together six to twelve people in a loosely structured format. The technique is based on the assump- 
tion that individuals are more willing to talk about things when they are able to do so within a 
group discussion format. Focus group respondents sometimes feed on each other’s comments to 
develop ideas that would be difficult to express in a different interview format. 

For example, suppose a consultant is hired by Carrefour to research the way consumers 
react to sales promotions. Carrefour began in France over 50 years ago and pioneered the dis- 
count hypermarket format. Carrefour is now the second largest retailer in the world (behind 
Walmart), operating nearly 11,000 stores in 29 countries. Specifically, the researcher is asked 
to help Carrefour executives decide whether or not the size of promotional discounts should 
vary with national culture. In other words, the basic research question is whether or not culture 
influences consumer perceptions of sales promotions.'' A pretest may be needed to examine 
whether or not differences in currency might interfere with these perceptions, or whether or not 
the different terms that refer to promotions and discounts can be translated into the languages 
of each culture. For example, is a discount expressed in Korean won interpreted the same way 
as a discount expressed in euros? Each euro equals about $1.28, whereas a single dollar is worth 
about 1,380 won.” 

Exploratory research need not always follow a structured design. Because the purpose of 
exploratory research is to gain insights and discover new ideas, researchers may use considerable 
creativity and flexibility. Some companies perform exploratory research routinely as part of envi- 
ronmental scanning. If the conclusions made during this stage suggest business opportunities, the 
researcher is in a position to begin planning a formal, quantitative research project. 
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literature review 


A directed search of published 
works, including periodicals and 
books, that discusses theory and 
presents empirical results that are 
relevant to the topic at hand. 


pilot study 


A small-scale research project 
that collects data from respon- 
dents similar to those to be used 
in the full study. 


pretest 


A small-scale study in which the 
results are only preliminary and 
intended only to assist in design 
of a subsequent study. 


focus group 


A small group discussion about 
some research topic led by a 
moderator who guides discus- 
sion among the participants. 
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A master plan that specifies the 
methods and procedures for 
collecting and analyzing the 

needed information. 
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STATING RESEARCH OBJECTIVES 


After identifying and clarifying the problem, with or without exploratory research, the researcher 
must formally state the research objectives. This statement delineates the type of research that is 
needed and what intelligence may result that would allow the decision maker to make informed 
choices. The statement of research objectives culminates the process of clarifying the managerial 
decision into something actionable. 

A written decision statement expresses the business situation to the researcher and makes sure 
that managers and researchers are on the same page. The research objectives try to directly address 
the decision statement or statements, as the case may be. As such, the research objectives represent 
a contract of sorts that commits the researcher to producing the needed research. This is why they 
are expressed as deliverables in applied business research. These research objectives drive the rest of 
the research process. Indeed, before proceeding, the researcher and managers must agree that the 
objectives are appropriate and will produce relevant information. 


LINKING DECISION STATEMENTS, OBJECTIVES, AND HYPOTHESES 


In Chapter 3 we discussed the role of theory and research hypotheses. Our hypotheses should 
be logically derived from and linked to our research objectives. For example, using our opening 
vignette as an example, the researcher may use theoretical reasoning to develop the following 
hypothesis: 


H1: The more hours per week a prospective student works, the more favorable the attitude toward online 
MBA class offerings. 


Exhibit 4.7 illustrates how decision statements are linked to research objectives, which are 
linked to research hypotheses. Although the first two objectives each have one hypothesis, notice 
that the third has two. In reality, most research projects will involve more than one research objec- 
tive, and each of these may often involve more than one hypothesis. Think about how you might 
go about trying to test the hypothesis listed in Exhibit 4.7. 


Decision Statement Research Objectives Hypotheses 

What should be the retail price Forecast sales for product X at Sales will be higher at $5.00 than at 

for product X? three different prices. $4.00 or at $6.99. 

In what ways can we improve Identify the top factors that Cleanliness is related positively to 

our service quality? contribute to customers’ customers’ service quality service 
perceptions. perceptions. 


Crowding is related negatively to 
customers’ service quality perceptions. 


Should we invest in a training Determine how much role Role conflict is related positively to job 
program to reduce role conflict conflict influences employee job satisfaction. 
among our employees? satisfaction. 


Planning the Research Design 


After the researcher has formulated the research problem, he or she must develop the research 
design as part of the research design stage. A research design is a master plan that specifies the 
methods and procedures for collecting and analyzing the needed information. A research design 
provides a framework or plan of action for the research. Objectives of the study determined during 
the early stages of research are included in the design to ensure that the information collected is 
appropriate for solving the problem. The researcher also must determine the sources of informa- 
tion, the design technique (survey or experiment, for example), the sampling methodology, and 
the schedule and cost of the research. 
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SELECTION OF THE BASIC RESEARCH METHOD 


Here again, the researcher must make a decision. Exhibit 4.6 shows four basic design techniques 
for descriptive and causal research: surveys, experiments, secondary data, and observation. The 
objectives of the study, the available data sources, the urgency of the decision, and the cost of 
obtaining the data will determine which method should be chosen. The managerial aspects of 
selecting the research design will be considered later. 

In business research, the most common method of generating primary data is the survey. Most 
people have seen the results of political surveys by Gallup or Harris Online, and some have been 
respondents (members of a sample who supply answers) to research questionnaires. A survey is a 
research technique in which a sample is interviewed in some form or the behavior of respondents 
is observed and described in some way. The term surveyor is most often reserved for civil engineers 
who describe some piece of property using a transit. Similarly, business researchers describe some 
group of interest (such as executives, employees, customers, or competitors) using a questionnaire. 
The task of writing a list of questions and designing the format of the printed or written question- 
naire is an essential aspect of the development of a survey research design. 

Research investigators may choose to contact respondents by telephone or mail, on the Inter- 
net, or in person. An advertiser spending $3 million for 30 seconds of commercial time during 
the Super Bowl may telephone people to quickly gather information concerning their responses 
to the advertising. The economic development director for a city trying to determine the most 
important factors in attracting new businesses might choose a mail questionnaire because the 
appropriate executives are hard to reach by telephone. A manufacturer of a birth control device 
for men might determine the need for a versatile survey method wherein an interviewer can ask a 
variety of personal questions in a flexible format. While personal interviews are expensive, they are 
valuable because investigators can use visual aids and supplement the interviews with observations. 
Each of these survey methods has advantages and disadvantages. A researcher’s task is to find the 
most appropriate way to collect the needed information in a particular situation. 

The objective of many research projects is merely to record what can be observed—for exam- 
ple, the number of automobiles that pass by a proposed site for a gas station. This can be mechani- 
cally recorded or observed by humans. Research personnel known as mystery shoppers may act 
as customers to observe actions of sales personnel or do comparative shopping to learn prices at 
competing outlets. A mystery shopper is paid to pretend to be a customer and gather data about 
the way employees behave and the way they are treated in general. How often are store policies 
followed? Are they treated courteously? Mystery shoppers can be valuable sources for observa- 
tional data. 

The main advantage of the observation technique is that it records behavior without relying 
on reports from respondents. Observational data are often collected unobtrusively and passively 
without a respondent’s direct participation. For instance, Nielsen Media Research uses a “people 
meter” attached to television sets to record the programs being watched by each household mem- 
ber. This eliminates the possible bias of respondents stating that they watched the president’s 
State of the Union address rather than Gossip Girl on another station. 

Observation is more complex than mere “nose counting,” and the task is more difficult than 
the inexperienced researcher would imagine. While observation eliminates potential bias from 
interviewer interaction, several things of interest, such as attitudes, opinions, motivations, and 
other intangible states of mind, simply cannot be observed. 


THE “BEST” RESEARCH DESIGN 


It is argued that there is no single best research design. As such, the researcher often has several 
alternatives that can accomplish the stated research objectives. Consider the researcher who must 
forecast sales for the upcoming year. Some commonly used forecasting methods are surveying 
executive opinion, collecting sales force composite opinions, surveying user expectations, project- 
ing trends, and analyzing environmental factors. Any one of these may yield a reliable forecast. 
The ability to select the most appropriate research design develops with experience. Inexpe- 
rienced researchers often jump to the conclusion that a survey methodology is usually the best 
design because they are most comfortable with this method. When Chicago’s Museum of Science 
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survey 


A research technique in which 

a sample is interviewed in some 
form or the behavior of respon- 
dents is observed and described 
in some way. 


PR NEWSFOTO/ROLLING ROCK 


Rolling Rock 

Making a mark in the U.S. beer market can be difficult. American 
consumers tend to favor milder beers at lower price points. Some 
argue that most beers taste very similar. Taste tests do reveal 
that similarly positioned beers do taste very much the same. 
However, the taste rankings do not correspond to market share. 
For instance, Stroh’s fared very well in the taste tests, but it is 
hardly a market leader. Rolling Rock rated 12th out of 12 beers 
tasted. Tasters said it tasted a bit like canned corn. Clearly, there 
is something more to a successful beer than taste. 

For many years Rolling Rock beer was a regional brand in 
western Pennsylvania. Its signature package was a longneck 
green bottle with a white painted label featuring icons such as 
a horse head, a steeplechase, the number “33,” and a legend 
about the beer being brought to you “from the glass-lined tanks 
of Old Latrobe.” The brand, now sold by Labatt USA, expanded 
nationally during the 1980s by focusing on core consumers who 
purchased specialty beers for on-premise consumption and who 
were willing to pay higher prices than for national brands such 
as Budweiser. 

As years went by, packaging options expanded to include 
bottles with ordinary paper labels for take-home consumption, 
often packaged in 12-packs. In the mid-1990s, in response to a 
competitive explosion from microbrews, Rolling Rock offered a 
number of line extensions, such as Rock Bock and amber Rock 
Ice. They failed. Sales stagnated. In New York and other crucial 
markets, price reductions to the level of Budweiser and Miller 
became inhibiting aspects of its marketing program. Business 
executives held the view that the longneck painted bottle 
was the heart of the brand. 
However, earlier efforts to 


develop cheaper imitations of 
the painted-label look had not 
achieved success. 


Rolling Rock executives decided to > \\' 
conduct a massive consumer study, recruit- | / 
ing consumers at shopping malls and f 
other venues to view “live” shelf sets of 
beer—not just specialty beer, but beer at 
every price range from subpremiums and up. 
Consumers given money to spend in the form of chips were 
exposed to “old-bundle” packages (the old graphics and the 
paper-label stubbies) and “new-bundle” packages (two new 
graphics approaches, including the one ultimately selected, and 
painted-label longnecks) at a variety of price points and asked 
to allocate chips to their next ten purchases. Some were even 
invited to take the “new-bundle” packages home with them for 
follow-up research. 

As the business executives had hoped, the results did not 
leave any room for interpretation: Not only did the new pack- 
ages meet with consumers’ strong approval, but consumers 
consistently indicated that they would be willing to pay more 
for the brand in those packages. In fact, not only were they will- 
ing to pay more; they expected to pay more, particularly among 
consumers already familiar with the Rock. In three regions, the 
Northeast, Southeast, and West, purchase-intent among users 
increased dramatically both at prices 20 cents higher per 12-pack 
and at prices 40 cents higher per 12-pack. The increase in pur- 
chase intent was milder in the Midwest, but there Rock already 
commanded a solid premium over Bud and other premium 
beers. The sole exception to that trend was in the brand's core 
markets in Pennsylvania and Ohio, where Rock has never entirely 
escaped its shot-and-a-beer origins, but even there, purchase 
intent declined by only 2 percent at each of the higher prices. 


Sources: Gerry Khermouch, “Sticking Their Neck Out,” BrandWeek (November 9, 
1998) 25-34, © 2006 VNU Business Media, Inc. Used with permission from 
Brandweek. © 1998-1999 VNU Business Media Inc.; “Which Brew for You?” 
Consumer Reports (August 2001), 10-17. 
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and Industry wanted to determine the relative popularity of its exhibits, it could have conducted 
a survey. Instead, a creative researcher familiar with other research designs suggested a far less 
expensive alternative: an unobtrusive observation technique. The researcher suggested that the 
museum merely keep track of the frequency with which the floor tiles in front of the various 
exhibits had to be replaced, indicating where the heaviest traffic occurred. When this was done, 
the museum found that the chick-hatching exhibit was the most popular. This method provided 
the same results as a survey but at a much lower cost. Take a look at the research design used by 


—Publius Syrus Rolling Rock illustrated in the Snapshot above. 


Sampling 


Although the sampling plan is outlined in the research design, the sampling stage is a distinct phase 
of the research process. For convenience, however, we will treat the sample planning and the 


x actual sample generation processes together in this section. 
sampling 


If you take your first bite of shrimp po-boy and conclude that it needs Tabasco, you have 
Involves any procedure that 


draws conclusions based on 
measurements of a portion 
of the population. 


just conducted a sample. Sampling involves any procedure that draws conclusions based on mea- 
surements of a portion of the population. In other words, a sample is a subset from a larger 
population. If certain statistical procedures are followed, a researcher need not select every item 
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in a population because the results of a good sample should have the same characteristics as the 
population as a whole. Of course, when errors are made, samples do not give reliable estimates of 
the population. 

A famous example of error due to sampling is the 1936 Literary Digest fiasco. The magazine 
conducted a survey and predicted that Republican Alf Landon would win over Democrat Franklin 
D. Roosevelt by a landslide in that year’s presidential election. This prediction was wrong—and 
the error was due to sample selection. The post-mortems showed that Literary Digest had sampled 
its readers and names drawn from telephone books and auto registrations. In 1936, not every- 
one had a telephone or a car; thus the sample was biased toward people with means. In reality, 
Roosevelt received over 60 percent of the popular vote. 

In 2004, early exit polls led many to believe that John Kerry would win the U.S. presidential 
election." The exit polls were performed early on election day and done mostly in highly urban 
areas in the Northeast, areas that are predominantly Democratic. The resulting sample of voters 
responding to the early exit polls did not represent the entire U.S. population, and Kerry lost to 
Bush by over 3 million votes, or about 3 percent of all votes cast. Thus, the accuracy of predictions 
from research depends on getting a sample that really matches the population. 

The first sampling question to ask is “Who is to be sampled?” The answer to this primary 
question requires the identification of a target population. Who do we want the sample to reflect? 
Defining this population and determining the sampling units may not be so easy. If, for example, a 
savings and loan association surveys people who already have accounts for answers to image ques- 
tions, the selected sampling units may represent current customers but will not represent potential 
customers. Specifying the target population is a crucial aspect of the sampling plan. 

The next sampling issue concerns sample size. How big should the sample be? Although 
management may wish to examine every potential buyer of a product or service, doing so may be 
unnecessary as well as unrealistic. Other things equal, larger samples are more precise than smaller 
ones. However, proper probability sampling can allow a small proportion of the total population 
to give a reliable measure of the whole. A later discussion will explain how large a sample must be 
in order to be truly representative of the universe or population. Essentially, this is a question of 
how much variance exists in the population. 

The final sampling decision is how to select the sampling units. Simple random sampling may 
be the best known type, in which every unit in the population has an equal and known chance 
of being selected. However, this is only one type of sampling. For example, if members of the 
population are found in close geographical clusters, a cluster sampling procedure (one that selects 
area clusters rather than individual units in the population) will reduce costs. Rather than select- 
ing 1,000 individuals throughout the United States, it may be more economical to first select 
25 counties and then sample within those counties. This will substantially reduce travel, hiring, 
and training costs. In determining the appropriate sampling plan, the researcher will have to select 
the most appropriate sampling procedure for meeting the established study objectives. 


Gathering Data 


The data gathering stage begins once the sampling plan has been formalized. Data gathering is 
the process of gathering or collecting information. Data may be gathered by human observers or 
interviewers, or they may be recorded by machines as in the case of scanner data and Web-based 
surveys. 

Obviously, the many research techniques involve many methods of gathering data. Surveys 
require direct participation by research respondents. This may involve filling out a questionnaire 
or interacting with an interviewer. In this sense, they are obtrusive. Unobtrusive methods of data 
gathering are those in which the subjects do not have to be disturbed for data to be collected. 
They may even be unaware that research is going on at all. For instance, a simple count of motor- 
ists driving past a proposed franchising location is one kind of data gathering method. However 
the data are collected, it is important to minimize errors in the process. For example, the data 
gathering should be consistent in all geographical areas. If an interviewer phrases questions incor- 
rectly or records a respondent’s statements inaccurately (not verbatim), major data collection errors 
will result. 


unobtrusive methods 
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Methods in which research 
respondents do not have to 
be disturbed for data to be 
gathered. 
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data analysis 


The application of reasoning to 
understand the data that have 
been gathered. 
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Processing and Analyzing Data 


EDITING AND CODING 


After the fieldwork has been completed, the data must be converted into a format that will answer 
the manager’s questions. This is part of the data processing and analysis stage. Here, the information 
content will be mined from the raw data. Data processing generally begins with editing and coding the 
data. Editing involves checking the data collection forms for omissions, legibility, and consistency in 
classification. The editing process corrects problems such as interviewer errors (an answer recorded on 
the wrong portion of a questionnaire, for example) before the data are transferred to the computer. 

Before data can be tabulated, meaningful categories and character symbols must be established 
for groups of responses. The rules for interpreting, categorizing, recording, and transferring the 
data to the data storage media are called codes. This coding process facilitates computer or hand 
tabulation. If computer analysis is to be used, the data are entered into the computer and verified. 
Computer-assisted (online) interviewing is an example of the impact of technological change on 
the research process. Telephone interviewers, seated at computer terminals, read survey questions 
displayed on the monitor. The interviewer asks the questions and then types in the respondents’ 
answers. Thus, answers are collected and processed into the computer at the same time, eliminat- 
ing intermediate steps that could introduce errors. 


DATA ANALYSIS 


Data analysis is the application of reasoning to understand the data that have been gathered. In its 
simplest form, analysis may involve determining consistent patterns and summarizing the relevant 
details revealed in the investigation. The appropriate analytical technique for data analysis will 
be determined by management’s information requirements, the characteristics of the research 
design, and the nature of the data gathered. Statistical analysis may range from portraying a simple 
frequency distribution to more complex multivariate analyses approaches, such as multiple regres- 
sion. Later chapters will discuss three general categories of statistical analysis: univariate analysis, 
bivariate analysis, and multivariate analysis. 


Drawing Conclusions and Preparing a Report 


One of the most important jobs that a researcher performs is communicating the research results. 
This is the final stage of the research project, but it is far from the least important. The conclusions 
and report preparation stage consists of interpreting the research results, describing the implications, 
and drawing the appropriate conclusions for managerial decisions. These conclusions should fulfill 
the deliverables promised in the research proposal. In addition, it’s important that the researcher 
consider the varying abilities of people to understand the research results. The report shouldn’t be 
written the same way to a group of Ph.D.’s as it would be to a group of line managers. 

All too many applied business research reports are overly complicated statements of technical 
aspects and sophisticated research methods. Frequently, management is not interested in detailed 
reporting of the research design and statistical findings, but wishes only a summary of the findings. 
If the findings of the research remain unread on the manager’s desk, the study will have been use- 
less. The importance of effective communication cannot be overemphasized. Research is only as 
good as its applications. 

Now that we have outlined the research process, note that the order of topics in this book 
follows the flowchart of the research process presented in Exhibit 4.4. Keep this flowchart in mind 
while reading later chapters. 


The Research Program Strategy 


Our discussion of the business research process began with the assumption that the researcher 
wished to collect data to achieve a specific organizational objective. When the researcher has only 
one or a small number of research objectives that can be addressed in a single study, that study is 


© GEORGE DOYLE & CIARAN GRIFFIN 


A 
za 


e Be sure to fully understand the differ- e Causal research is the only research that establishes 
ing roles of exploratory, descriptive, cause-and-effect relationships. Most commonly, causal 
and causal research: research takes the form of experiments such as test 
e Exploratory research provides new markets. 
insights—the domain of discovery in philosophy e A major flaw in business research is to not give due diligence 
of science terms—and often sets the groundwork to exploratory research (especially secondary data and quali- 
for further investigation. tative research). Instead, researchers often move too quickly 
e Descriptive research describes the characteristics of to collecting descriptive data. 


objects, people, or organizations. Much of business infor- e A second, and related, flaw in business research is to fail to 
mation is based on descriptive research. carefully define the research objectives. 


referred to as a research project. We have emphasized the researcher’s need to select specific tech- 
niques for solving one-dimensional problems, such as identifying customer segments, selecting the 
most desirable employee insurance plan, or determining an IPO stock price. 

However, if you think about a firm’s business activities in a given period of time (such as a 
year), you'll realize that business research is not a one-shot activity—it is a continuous process. 
An exploratory research study may be followed by a survey, or a researcher may conduct a spe- 
cific research project for each business tactical decision. If a new product is being developed, 
the different types of research might include studies to identify the size and characteristics of the 
market; product usage testing to record consumers’ reactions to prototype products; brand name 
and packaging research to determine the product’s symbolic connotations; and test-marketing the 
new product. Thus, when numerous related studies come together to address issues about a single 
company, we refer to this as a research program. Because research is a continuous process, man- 
agement should view business research at a strategic planning level. The program strategy refers to 
a firm’s overall plan to use business research. It is a planning activity that places a series of research 
projects in the context of the company’s strategic plan. 

The business research program strategy can be likened to a term insurance policy. Conduct- 
ing business research minimizes risk and increases certainty. Each research project can be seen as a 
series of term insurance policies that makes the manager’s job a bit safer. 


Summary 


1. Define decision making and understand the role research plays in making decisions. Decision 
making occurs when managers choose among alternative ways of resolving problems or pursuing 
opportunities. Decision makers must recognize the nature of the problem or opportunity, identify 
how much information is available, and recognize what information they need. Every business 
decision can be classified on a continuum ranging from complete certainty to absolute ambiguity. 
Research is a way that managers can become informed about the different alternatives and make 
an educated guess about which alternative, if any, is the best to pursue. 


2. Classify business research as either exploratory research, descriptive research, or causal 
research. Exploratory, descriptive, and causal research are three major types of business research 
projects. The clarity with which the decision situation is defined determines whether exploratory, 
descriptive, or causal research is most appropriate. When the decision is very ambiguous, or the 
interest is on discovering new ideas, exploratory research is most appropriate. Descriptive research 
attempts to paint a picture of the given situation by describing characteristics of objects, people, or 
organizations. Causal research identifies cause-and-effect relationships. Or, in other words, what 
change in “Y” will occur when there is some change in “X”? Three conditions must be satisfied 
to establish evidence of causality: 1) temporal sequence—the cause must occur before the effect; 
2) concomitant variation—a change in the cause is associated (correlated) with a change in the 
effect; and 3) nonspurious association—the cause is true and not eliminated by the introduction 
of another potential cause. 


research project 


A single study that addresses one 
or a small number of research 
objectives. 


research program 


Numerous related studies that 
come together to address mul- 
tiple, related research objectives. 
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3. List the major phases of the business research process and the steps within each. The six major 
phases of the research process discussed here are 1) defining the research objectives, 2) planning 
the research design, 3) sampling, 4) data gathering, 5) data processing and analysis, and 6) drawing 
conclusions and report preparation. Each stage involves several activities or steps. For instance, in 
planning the research design, the researchers must decide which type of study will be done and, 
if needed, recruit participants and design and develop experimental stimuli. Quite often research 
projects are conducted together as parts of a research program. Such programs can involve suc- 
cessive projects that monitor different elements of a firm’s operations. 


4. Explain the difference between a research project and a research program. A research project 
addresses one of a small number of research objectives that can be included in a single study. In 
contrast, a research program represents a series of studies addressing multiple research objectives. 
Many business activities require an ongoing research task of some type. 
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Questions for Review and Critical Thinking 


1. List five ways that business research can contribute to effective b. Ranking the key factors new college graduates are seeking 


business decision making. in their first career position 
2. Define business opportunity, business problem, and symptoms. Give c. Estimating the 5-year sales potential for Cat-Scan machines 
an example of each as it applies to a university business school. in the Ark-La-Tex (Arkansas, Louisiana, and Texas) region 
of the United States 


Testing the effect of “casual day” on employee job satisfaction 


3. Consider the following list, and indicate and explain whether 
each best fits the definition of a problem, opportunity, or d. 


symptom: e. Discovering the ways that people who live in apartments 


a. A 12.5 percent decrease in store traffic for a children’s shoe 


store in a medium-sized city mall. 


actually use vacuum cleaners, and identifying cleaning tasks 
for which they do not use a vacuum 


b. Walmart’s stock price has decreased 25 percent between 5. Describe the type of research evidence that allows one to infer 
2007 and 2009. causality. 

c. A furniture manufacturer and retailer in North Carolina 6. What is an experimental manipulation? A business researcher is 
reads a research report indicating consumer trends toward hired by a specialty retail firm. The retailer is trying to decide 
Australian Jara and Kari wood. The export of these prod- what level of lighting and what temperature it should maintain 
ucts is very limited and very expensive. in its stores to maximize sales. How can the researcher manip- 

d. Marlboro reads a research report written by the U.S. FDA. ulate these experimental variables within a causal design? 


It indicates that the number of cigarette smokers in sub- 7. 
Saharan Africa is expected to increase dramatically over 
the next decade. 


4. What are the three types of business research? Indicate which 
type each item in the list below illustrates. Explain your 


answers. 


a. 


Establishing the relationship between advertising and sales 
in the beer industry 


A business researcher gives a presentation to a music industry 
executive. After considering the results of a test-market exam- 
ining whether or not lowering the price of in-store CDs will 
lower the number of illicit downloads of the same music, the 
executive claims: “The test-market was conducted in eight cit- 
ies. In two of the cities, lowering the price did not decrease 
illicit downloading. Therefore, lowering the price does not 
decrease this behavior, and we should not decide to lower 
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prices based on this research.” Comment on the executive’s 
conclusion. What type of inference is being made? Will the 
decision not to lower prices be a good one? 

8. We introduced the scientific method in Chapter 3. Do the 
stages in the research process discussed here seem to follow the 
scientific method? 

9. Why is the “define research objectives” of the research process 
probably the most important stage? 

10. Suppose Auchan (http://www.auchan.fr), a hypermarket chain 
based out of France, was considering opening three hypermar- 
kets in the midwestern United States. What role would theory 
play in designing a research study to track how the shopping 
habits of consumers from the United States differ from those in 
France and from those in Japan? What kind of hypothesis might 
be examined in a study of this topic? 

11. Define research project and research program. Referring to the 
question immediately above, do you think a research project 
or a research program is needed to provide useful input to the 
Auchan decision makers? 
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12. What type of research design would you recommend in 

the situations below? For each applied business research 

project, what might be an example of a “deliverable”? Which 

do you think would involve actually testing a research 
hypothesis? 

a. The manufacturer of flight simulators and other pilot training 
equipment wishes to forecast sales volume for the next five 
years. 

b. A local chapter of the American Lung Association wishes to 
identify the demographic characteristics of individuals who 
donate more than $500 per year. 

c. Caterpillar Inc. is concerned about increasing inventory 
costs and is considering going completely to a just-in-time 
inventory system. 

d. A food company researcher wishes to know what types 
of food are carried in brown-bag lunches to learn if the 
company can capitalize on this phenomenon. 

e. A researcher wishes to identify who plays bingo. 


Research Activities 


1. ‘NET Look up information about the online MBA programs at 
the University of Phoenix (http://www.mba-online-program.com/ 
university_of_phoenix_online_mba.html). Compare it to the tra- 
ditional MBA program at your university. Suppose each was 
looking to expand the numbers of students in their programs, 
how might the research design differ for each? 

2. ‘NET Use a Web browser to go to the Gallup Organization’s 
home page at (http://www.gallup.com). The Gallup home page 
changes regularly. However, it should provide an opportu- 
nity to read the results of a recent poll. For example, a poll 
might break down American’s sympathies toward Israel or the 


Palestinians based on numerous individual characteristics such 
as political affiliation or religious involvement. After reading 
the results of a Gallup poll of this type, learn how polls are 
conducted. You may need to click “about Gallup” and/or 
Frequently Asked Questions List (FAQ) to find this information 
on how the polls are conducted. List the various stages of the 
research process and how they were (or were not) followed in 
Gallup’s project. 

3. Any significant business decision requires input from a research 
project. Write a brief essay either defending this statement or 
refuting it. 


Case 4.1 A New “Joe” on the Block 


Joe Brown is ready to start a new career. After 
spending 30 years as a market researcher and inspired 
by the success of Starbucks, he is ready to enter the 
coffee shop business. However, before opening his 

_ first shop, he realizes that a great deal of research is 
I. needed. He has some key questions in mind. 
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e What markets in the United States hold the most promise for a 
new coffee shop? 

e What type of location is best for a coffee shop? 

e What is it that makes a coffee shop popular? 

e What coffee do Americans prefer? 


A quick trip to the Internet reveals more previous research on cof- 
fee, markets, and related materials than he expected. Many studies 
address taste. For example, he finds several studies that in one way 
or another compare the taste of different coffee shop coffees. Most 
commonly, they compare the taste of coffee from Starbucks against 


coffee from McDonald’s, Dunkin’ Donuts, Burger King, and some- 
times a local competitor. However, it becomes difficult to draw a 
conclusion as the results seem to be inconsistent. 


e One study had a headline that poked fun at Starbucks’ high- 
priced coffee. The author of this study personally purchased 
coffee to go at four places, took them to his office, tasted them, 
made notes and then drew conclusions. All the coffee was tasted 
black with no sugar. Just cups of joe. He reached the conclusion 
that McDonald’s Premium Coffee (at about $1.50 a cup), tasted 
nearly as good as Starbucks House Blend (at about $1.70 a cup), 
both of which were much better than either Dunkin’ Donuts 
(at about $1.20) or Burger King (less than $1). This study argued 
that McDonald’s was best, all things considered. 

e Another study was written up by a good critic who was sim- 
ply interested in identifying the best-tasting coffee. Again, he 
tasted them all black with nothing added. Each cup of coffee 
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was consumed in the urban location near the inner city center 
in which he lived. He reached the conclusion that Starbucks’ 
coffee had the best flavor although it showed room for improve- 
ment. McDonald’s premium coffee was not as good, but better 
than the other two. Dunkin’ Donuts coffee had reasonably 
unobjectionable taste but was very weak and watery. The 
Burger King coffee was simply not very good. 

e Yet another study talked about Starbucks becoming a huge 
company and how it has lost touch with the common coffee 
shop coffee customer. The researchers stood outside a small 
organic specialty shop and interviewed 100 consumers as they 
exited the shop. They asked, “Which coffee do you prefer?” 
The results showed a preference for a local coftee, tea, and 
incense shop, and otherwise put Starbucks last behind McDonald’s, 
Burger King, and Dunkin’ Donuts. 

e Still another study compared the coffee-drinking experience. A 
sample of 50 consumers in St. Louis, Missouri, were interviewed 
and asked to list the coffee shop they frequented most. Starbucks 
was listed by more consumers than any other place. A small 
percentage listed Dunkin’ Donuts but none listed McDonald’s, 
despite their efforts at creating a premium coffee experience. 
The study did not ask consumers to compare the tastes of the 
coffee across the different places. 


Joe also wants to find data showing coffee consumption pat- 
terns and the number of coffee shops around the United States, so 
he spends time looking for data on the Internet. His searches don’t 
reveal anything satisfying. 

As Joe ponders how to go about starting “A Cup of Joe,” he 
wonders about the relevance of this previous research. Is it useful at 
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all? He even questions whether he is capable of doing any primary 
research himself and considers hiring someone to do a feasibility 
study for him. Maybe doing research is easier than using research. 


Sources: Shiver, J., “Taste Test: The Little Joes Take on Starbucks,” USA Today 
(March 26, 2008), http://www.usatoday.com/money/industries/food/2006-03-26- 
coffee_x.htm, accessed July 20, 2008; Associated Press, “McDonald’s Coffee Beats 
Starbucks, Says Consumer Reports,” The Seattle Times (February 2, 2007), http:// 
seattletimes.nwsource.com/html/businesstechnology/2003553322_webcoffeetest02. 
html, accessed July 20, 2008; “Coffee Wars: Starbucks v McDonald’s,” The Economist 
386 (January 10, 2008), 58. 


Questions 

1. What are the top three key decisions faced by Joe? 

2. What are the key deliverables that an outside researcher should 
produce to help Joe with the key decisions? 

3. How relevant are the coffee taste studies cited above? Explain. 

4. What flaws in the coffee taste studies should Joe consider in try- 
ing to weigh the merits of their results? 

5. Briefly relate this situation to each of the major stages of the 
marketing research process. 

6. Try to do a quick search to explore the question: “Are Ameri- 
can consumer preferences the same all across the United States?” 

7. Would it be better for Joe to do the research himself or have a 
consultant perform the work? 

8. Ifa consultant comes in to do the job, what are three key 
deliverables that would likely be important to Joe in making 
a decision to launch the Cup of Joe coffee shop. 
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industry 


3. Understand the often conflicting relationship between 
management and researchers 


4. Define ethics and understand how it applies to business 
research 
5. Know and appreciate the rights and obligations of 


a) research respondents—particularly children, b) business 
researchers, and c) research clients or sponsors 


6. Know how to avoid a conflict of interest in performing 
business research 


Chapter Vignette: They Do Want Better Pay, Right? 


Amy has worked as a research analyst for an established snack food company for three years now. She 
was assigned as an internal consultant to the general manager of one of the manufacturing plants to 


assist in a salary and benefits study of the plant employees. Her partner on the project is the senior 


supervisor of the employees in the plant, and the data collection and analyses 
up to this point had gone well. 


Her partner on the project, Raymond, was very support- 

ive, and had given her access to the employees to conduct 

a detailed salary survey, outlining the current satisfaction 

with the plant supervision, salary, and health benefits. Her 

initial analyses and results were fairly clear—the employees 
were satisfied with the health and benefits associated with the 
plant, and they were generally satisfied with the plant man- 
agement. However, the questions regarding pay were clear as 
well—the employees felt they were underpaid, given the work 
that they did for the company. When Amy examined the open- 
ended responses, the employee attitudes toward their pay were 
overwhelmingly negative. To her, this was clearly an issue that 
needed some follow-up. 

She approached Raymond about these initial results. “Do you 
think we should contact HR, and see how our employees’ pay 
stacks up with other local manufacturing companies?” She asked. 
Raymond's response surprised her, given his previous support of the 
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project. “I wouldn't pay any attention to those results. Everyone wants more money. We have noth- 
ing to worry about there, and we will not contact HR regarding competitive wages around here,” he 
stated. Amy pressed him further. “But it is very clear what their perception is. What is the problem 
with checking into this a little with HR? It can’t hurt to just ask. | want to make sure that the results of 
the study are consistent with what the employees say.” Raymond was adamant. “We will focus on the 
positive. The benefits responses look good to me. Let’s not involve a bunch of other people on this. 
HR is fine.” Amy did not know what to say. She felt that she was being steered in a particular direction. 
She needed some guidance, and the only person she could turn to was her supervisor. 
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“What am | supposed to report on this project?” Amy said to the research vice president. “I get 
the feeling that they don’t want to hear the results. It’s like they are trying to manage me on this. The 
employees say they want better pay. They do want better pay, right?” 


outside agency 


An independent research firm 
contracted by the company that 
actually will benefit from the 
research. 


in-house research 


Research performed by 
employees of the company that 
will benefit from the research. 


—Marion Harper 


Introduction 


The vignette described above involves a researcher who faces a challenge in what is learned 
from the research process. Many companies have their own employees perform research proj- 
ects and research programs. Thus, research is sometimes performed in-house, meaning that 
employees of the company that will benefit from the research project actually perform the 
research. In other cases, the research is performed by an outside agency, meaning that the com- 
pany that will benefit from the research results hires an independent, outside firm to perform a 
research project. 

While it would seem that in-house research would usually be of higher quality because of 
the increased knowledge of the researchers conducting the studies, there are several reasons why 
employees of the firm may not always be the best people to do the job. When the firm facing 
a decision encounters one of the following situations, they should consider having the research 
performed by an outside agency: 


e An outside agency often can provide a fresh perspective. Creativity is often hindered by 
too much knowledge. When a firm is seeking new ideas, particularly in discovery-oriented 
research, an outsider is not constrained by the groupthink that often affects a company 
employee. In other words, employees who spend so much time together in their day-to-day 
work activities begin to act and think alike to a large degree. For example, history is filled 
with stories of products that remained unsuccessful commercially for years until someone 
from outside the company discovered a useful application. The technology for a microwave 
oven was invented in the 1940s by a company called Raytheon. Raytheon worked on radar 
systems for the Allied military in World War II. Not until someone from another company, 
Amana, tested the concept of using microwaves in a kitchen appliance did it become a com- 
mercial success. Some of the largest outside research agencies are shown in Exhibit 5.2. 

e An outside agency often can be more objective. When a firm is facing a particularly sensi- 
tive situation that may even impact a large number of jobs within the company, it may be 
difficult for researchers to be objective. Alternatively, if a particular chief executive within 
the firm is in love with some new idea, researchers may feel a great deal of pressure to pre- 
sent results that are supportive of the concept. In these cases, outside researchers may be a 
good choice. Since they don’t have to work for the company and interact with the players 
involved on a daily basis, they are less concerned about presenting results that may not be 
truly welcome. 

e An outside agency may have special expertise. When a firm needs research requiring a par- 
ticular expertise that some outside agency specializes in, it may be a good idea to use that firm 
to conduct the research. For example, if a company is searching for new ideas about how to 
use its Web site, an online focus group interview may be needed. While this is a skill that 
may not be prevalent within the company, there are several research firms that specialize in 
this particular type of research. Thus, the outside agency may have greater competency in this 
specific area. 


Likewise, there are conditions that make in-house research more attractive as well, as in the fol- 
lowing situations: 


¢ Ifthe research project needs to be completed very quickly, chances are that in-house research- 
ers can get started more quickly and get quicker or better access to internal resources that can 
help get the project done in short order. 

e If the research project will require the close collaboration of many other employees from 
diverse areas of the organization, then in-house research may be preferable. The in-house 
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a) H One of the questions in 
$ the BRM questionnaire 
í V screened respondents based 
A on whether or not the per- 
K son is employed. For those 
respondents who do have a job, a 
series of questions pertaining to their 
job followed. Take a look at the chapter vignette. 
Do any of the questions capture information that 
might be helpful in understanding employees’ 
attitudes about their compensation? Which item 
or items might be helpful in a situation like this? 


research team can usually gain cooperation and more quickly ascertain just who needs to be 
interviewed and where those people can be found. 

e A third reason for doing a project in-house has to do with economy. In-house research can 
almost always be done more cheaply than that done by an outside research firm. 

* If secrecy is a major concern, then the research is best done in-house. Even though the outside 
firm might be trusted, it may take slightly less care in disguising its research efforts. Thus, other 
companies may pick up on signals in the marketplace that suggest the area of research for a 
firm. (See Exhibit 5.1.) 


EXHIBIT 5.1 
: Should Research Be Done 
Advantages of In-House Research: Advantages of An Outside Agency: In-House or By an Outside 
Agency? 
imi g ina | CANEDA 
e Quick turn-around e Fresh perspective 
e Better collaboration e More objectivity 
w/employees e Special expertise 


e Cheaper costs 
e Secret process 


This chapter focuses on the human side of research. We first discuss the internal working of a research 
unit within a large company. We then turn to the different types of options that exist when dealing with 
an outside agency. Some of the largest research companies are presented in Exhibit 5.2 on page 79. All 
of this is wrapped up by a discussion of the many ways in which ethics and research come together. 


Organizational Structure of Business Research 


The placement of business research within a firm’s organizational structure and the structure of the 
research department itself vary substantially, depending on the firm’s acceptance of the concept of 
internal research and its stage of research sophistication. A research department can easily become 
isolated with poor organizational placement. Researchers may lack a voice in executive committees 
when they have no continuous relationship with management. This can occur when the research 
department is positioned at an inappropriately low level. Given the critically important nature of the 
intelligence coming out of a research department, it should be placed relatively high in the organiza- 
tional structure to ensure that senior management is well informed. Research departments should also 
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be linked with a broad spectrum of 
other units within the organization. 
Thus, they should be positioned to 
provide credible information both 


J 
tae 


When research departments 
grow, they begin to specialize 
by product or business unit. 
This happened in the Marriott 
Corporation, which now has a 
specific director of research for 
its lodging facilities. 


research analyst 


A person responsible for client 
contact, project design, prepara- 
tion of proposals, selection of 
research suppliers, and supervi- 
sion of data collection, analysis, 
and reporting activities. 


research assistants 


Research employees who 
provide technical assistance 
with questionnaire design, data 
analyses, and similar activities. 


upstream and downstream within 
the organization. 

Research departments that 
perform a staff function must wait 
for management to request assis- 
tance. Similar to Amy’s situation, 
often the term “client” or “inter- 
nal consultant” is used by the 
research department to refer to 
line management for whom ser- 


‘il 


vices are being performed. The 


research department responds to 
clients’ requests and is responsible 


for the design and execution of all 
research. It should function like an 
internal consulting organization 


that develops action-oriented, 


data-based recommendations. 


Business Research Jobs 


Research organizations themselves consist of layers of employees. Each employee has certain spe- 
cific functions to perform based on his or her area of expertise and experience. A look at these jobs 
not only describes the potential structure of a research organization, but it also provides insight 
into the types of careers available as a business research specialist. 


SMALL FIRMS 


While it is difficult to precisely define the boundaries between small firms, mid-sized firms, 
and large firms, generally speaking, government statistics usually consider firms with fewer than 
100 employees to be small. In small firms, the vice president of marketing may be in charge of 
all significant internal research projects. This officer may focus on organizational research projects 
that relate to staffing or stakeholder relations, or may be a sales manager who collects and analyzes 
sales histories, trade association statistics, and other internal data. Small companies usually have 
few resources and special competencies to conduct large-scale, sophisticated research projects. An 
advertising agency or a business consulting firm that specializes in research will be contracted if a 
large-scale survey is needed. At the other extreme, a large company like Procter & Gamble may 
staff its research departments with more than 100 people. 


MID-SIZED FIRMS 


Mid-sized firms can be thought of as those with between 100 and 500 employees. In a mid-sized firm, 
the research department may reside in the organization under the director of marketing research, as 
shown in Exhibit 5.3 on page 80.This person provides leadership in research efforts and integrates all 
staff-level research activities. (This position will be discussed in greater detail in the next section.) 

A research analyst is responsible for client contact, project design, preparation of proposals, 
selection of research suppliers, and supervision of data collection, analysis, and reporting activities. 
Normally, the research analyst is responsible for several projects simultaneously covering a wide 
spectrum of the firm’s organizational activities. He or she works with product or division manage- 
ment and makes recommendations based on analysis of collected data. 

Research assistants (or associates) provide technical assistance with questionnaire design, 
data analyses, and so forth. Another common name for this position is junior analyst. The 
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The Largest Research Firms in the World 


Approximate 
Home Number of Revenue 
Company Country Web Site Employees (millions) 
1 The Nielsen Company USA www.nielsen.com 39,500 3,696 
2 IMS Health Inc. USA www.imshealth.com 7,400 2,000 
3 TNS UK www.tns-global.com 14,600 1,850 
4 The Kantar Group UK www.kantargroup.com 6,900 1,400 
5 GfK AG Germany www.gfk.com 9,000 1,400 
6 lpsos Group France www.ipsos.com 6,500 1,100 
7 Synovate UK www.synovate.com 6,000 750 
8 IRI USA www.infores.com 3,600 700 
9 Westat Inc. USA www.westat.com 2,000 425 
10 Arbitron USA www.arbitron.com 1,050 350 
11 INTAGE Inc Japan www.intage.co.jp 1,600 265 
12 JD Power USA www.jdpa.com 850 230 
13 Harris Interactive Inc USA www.harrisinteractive.com 1,100 220 
14 Maritz Research USA www.maritzresearch.com 800 215 
15 The NPD Group USA www.npd.com 950 190 
16 Video Research Japan www.videor.co.jp 400 175 
17 Opinion Research Corp. USA www.opinionresearch.com 675 155 
18 IBOPE Brazil www.ibope.com.br 1,700 105 
19 Lieberman Research USA www.Irwonline.com 300 80 
Worldwide 
20 Telephia Inc USA www.telephia.com 250 70 


Sources: “Top 50 US Market Research Firms,’ Marketing News, (June 15, 2008), H4; "Top 25 Global Research Organizations,’ Marketing News, August 15, 2007), H4. 


manager of decision support systems supervises the collection and analysis of sales, inventory, and manager of decision 
other periodic customer relationship management (CRM) data. Sales forecasts for product lines Support systems 

usually are developed using analytical and quantitative techniques. Sales information is provided Employee who supervises the 
collection and analysis of sales, 
inventory, and other periodic 


. : . customer relationship manage- 
running computer programs and manipulating data to forecast sales for the firm. ment (CRM) data. 


to satisfy the planning, analysis, and control needs of decision makers. The manager of decision 
support systems may be assisted by a forecast analyst who provides technical assistance, such as 


Personnel within a planning department may perform the research function in a mid-sized 
firm. At times, they may outsource some research functions, depending on the size of the project forecast analyst 
and the degree of sophistication. The planner may design research studies and then contract with Employee who provides techni- 
cal assistance such as running 
computer programs and manipu- 
lating data to generate a sales 
forecast. 


outside firms that supply research services such as interviewing or data processing. They can com- 
bine the input from these outside agencies with their own work to write research reports. 


LARGE RESEARCH FIRMS 


As research departments grow, they tend to specialize by product or strategic business unit. Major 
firms can be thought of as those with over 500 employees. Marriott Corporation has a director 
of research for lodging (for example, Marriott Hotels and Resorts, Courtyard by Marriott, and 
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Fairfield Inn) and a director of research for contract services and restaurants (for example, Roy 
Rogers, Big Boy, and Senior Living Services). Each business unit’s research director reports to 
the vice president of corporate marketing services. Many large organizations have managers of 
customer quality research who specialize in conducting surveys to measure consumers’ satisfaction 
with product quality. 

In many instances, business research units are located within a firm’s marketing function. 
Exhibit 5.3 illustrates the organization of a typical major firm’s marketing research department. 
Within this organization, the centralized research department conducts research for all the divi- 
sion’s product groups. This is typical of a large research department that conducts much of its own 
research, including fieldwork. 


EXHIBIT 5.3 Organization of the Marketing Research Department in a Large Firm 


Supervisor | | Supervisor Supervisor || Supervisor Supervisor | | Supervisor Supervisor Supervisor | | Supervisor 
Product Product Customer Employee Marketing || Promotion || Fundamental Marketing Marketing 
Research || Research Satisfaction || Research? Practice Research® Research¢/ Statistics | | Information 

Research Research? Environmental from 
Research Syndicated 
Services 


(by product groupings) 


*Conducts research to improve total quality management in production. 

’Conducts research that cuts across product lines or involves competitive marketing practices or characteristics of customer groups. 
‘Conducts research that cuts across product lines to measure the effectiveness of promotional activities. 

‘Conducts research aimed at gaining a basic understanding of various elements of the marketing process. 


Other positions within a major firm’s research department may include director of data collec- 
tion (field supervisor), manager of quantitative research, focus group moderator, and manager of 


data processing. These are not shown in Exhibit 5.3. Even large firms sometimes outsource some 


less important the iob research functions or even an entire project from time to time. For now, we turn our attention 
3 | PUTLart iri JUU. 


to the job of director of research and the interface between the research department and other 
—George McGovern 


departments. 


The Director of Research as a Manager 


A director of research plans, executes, and controls the firm’s research function. This person 
typically serves on company executive committees that identify competitive opportunities and 
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4 Marketing Research Pays 
Marketing research can pay! Careers in 
marketing research can be very lucra- 

tive. This is particularly true if one has the right 
attributes. These attributes include being a good 
people person as well as having good quantitative skills and a 
good education. The fastest career tracks in marketing research 
are for those with at least a master’s degree. 

The prospects of finding a job remain good. Marketing 
researchers have long been in greater demand than the sup- 
ply can address. The salaries also can be very lucrative. The 
2002 U.S. Department of Labor Salary Survey suggests that 
marketing research analysts’ salaries are generally between 
$40,000 and $80,000. These are for actual research analysts 
and not research directors. Beginning research employees, 
with little or no experience, generally enter the firm as a sur- 
vey researcher. Those salaries are considerably less, generally 
between $20,000 and $40,000. However, they require no sig- 
nificant work experience. 

Job opportunities in marketing research exist outside the 
United States as well. The salaries also are lucrative in other coun- 
tries. The chart below shows salaries for non-managerial mar- 
keting research positions in the United States, Australia, Japan, 
and the United Kingdom. For comparison purposes, salaries for 


non-managerial sales employees also are provided. The salaries 
are expressed in thousands of U.S. dollars and reflect the latest 
available statistics. As can be seen, research jobs compare very 
favorably. In addition, researchers that move into research direc- 
tor positions see a substantial increase in pay. Perhaps you'll give 
marketing research a try? 


United 

Common Currency ($) Australia UK Japan States 
Sales Market Analysts 

High 44.78 122.81 82.82 55.00 

Low 33.58 61.40 41.41 35.00 
Marketing Research 

High 55:97. 78:95 82.82 7630 

Low 48.51 43.86 49.69 38.76 


Sources: Enright, A., “Carve out a Niche,” Marketing News (November 15, 2005), 

17; Fellman, M. W., “Survey: Employment Levels Critically Low in MR Industry,” 
Marketing News 322 (June 8, 1998), 12; U.S. Department of Labor, “Wages, Benefits 
and Earnings” (2006), http://www 
.bls.gov/bls/wages.htm, accessed 
May 2, 2006. Walters, Robert, “Market 
Research Search Results,” http://www 
.robertwalters.com (2006), accessed 
January 20, 2006. 


formulate strategies that involve customers or other organizational stakeholders. The various 


directors from each functional area generally make up this committee (such as finance, sales, 


production, and so forth). The director of research provides the research perspective during meet- 


ings. For instance, the researcher can provide input as to what types of business intelligence can 


be feasibly obtained given the decision being discussed. Research directors typically face problems 


like these: 


e Skilled research professionals may like conducting research better than managing people. They 


pride themselves on being hands-on researchers. However, a director is a manager and spends 


more time in meetings and managing than actually conducting research. 


e The research management role often is not formally recognized. 
e Outstanding research professionals often have trouble delegating responsibility. The pride that 
comes with being a knowledgeable researcher makes it difficult to give up control. They may 


genuinely feel “I can do it better myself.” As a result, they delegate only elementary or tedious 
tasks to subordinates. The subordinates can sometimes become disenchanted and thus become 


unhappy with their work. 


e Finally, research is often seen as a hodgepodge of techniques available to answer individual, 


unrelated questions. According to this view, a research operation encompasses an array of 


more or less equal projects, each handled by a project director. Hence, many firms view a 


full-time director as unnecessary.’ 


Sources of Conflict between Senior 
Management and Research 


In principle, the functions of research should merge harmoniously with the objectives of manage- 


ment for the benefit of both parties. In practice, the relationship between a research department 


and the users of research frequently is characterized by misunderstanding and conflict. 
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RESEARCH THAT IMPLIES CRITICISM 


As we saw in the chapter vignette, a product manager who requests a survey of dealer loyalty will 
not be happy if the survey finds that the dealers are extremely critical. Similarly, a sales manager 
who informally projects a 5 percent increase in sales will not like hearing from the research 
department that the market potential indicates sales volume should be up by 20 percent. In each 
of these situations, the research presents information that implies criticism of a line executive’s 
decision. In personal life, a sure way to lose a friend is to be openly critical of him or her. Things 
are no different in business. 


MONEY 


Research budgets are a source of conflict between management and researchers. Financial managers 
often see research as a cost rather than as an investment or a way of lowering risk. Successful decisions 
that are supported by research are seldom attributed to the researcher. Thus, as is often true in many 
areas of business, managers often want to spend as little as possible on research. In contrast, research- 
ers often vigorously resist cutting corners in conducting research. For instance, they may feel that a 
large random sample is necessary to adequately address a research question using descriptive research. 
This approach can be very expensive and sometimes time consuming. Inevitably, management’s 
desire to save money and the researcher’s desire to conduct rigorous research conflict. Successful 
research projects often are those that are based on compromise. This may involve working within a 
budget that will produce meaningful results and sacrifice precision and rigor minimally. 


TIME 


Researchers say, “Good research takes time!” Managers say, “Time is money!” Like oil and water, 
these two views do not go together easily. A look back at the research process in the last chapter 
makes it clear that it can take some time to complete a research project. Simply planning one can 
involve days, if not weeks, of study and preparation. For instance, conducting a literature review 
or a review of previous studies can take weeks. Without them, the researcher may not be able 
to develop specific research hypotheses that would direct the project very specifically toward the 
current issue. Other times, the researcher may wish to interview more people than time can allow 
or take the time to use a more sophisticated data analysis approach. 

Oftentimes, the more quickly the research project is done, the less likely it is to be successful. 
This doesn’t mean it can’t provide valuable information. It simply is not as certain that a quickly put- 
together study will provide valuable answers as would a more deliberately planned project.When studies 
are rushed, the following sources of error become more prominent than they would be otherwise: 


e Conducting a study that is needed. Taking more time to perform a literature search, including 
through company and industry reports, may have provided the needed intelligence without a 
new study. 

e Addressing the wrong issue. Taking more time to make sure the decision statement is well 
defined and that the research questions that follow will truly address relevant issues can lessen 
the chance that the research goes in the wrong direction. 

e Sampling difficulties. Correctly defining, identifying, and contacting a truly representative 
sample is a difficult and time consuming task. However, in some types of research, the quality 
of results depends directly on the quality of the sample. 

e Inadequate data analysis. The researcher may analyze the data quickly and without the rigor 
that would otherwise be taken. Therefore, certain assumptions may not be considered, and 
important information within the data is simply not discovered. 


Sometimes a researcher will have to submit to the time pressure and do a quick-and-dirty 
study. A sudden event can make it necessary to acquire data quickly—but rush jobs can some- 
times be avoided with proper planning of the research program. If it is necessary to conduct a 
study under severe time limitations, the researcher is obligated to point this out to management. 
The research report and presentation should include all the study limitations, including those that 
resulted from a shortage of time or money. 


l When Your Brain “Trips Up” Scientists recognize that any decision maker is a victim 


x Son Leaders Make Bad Decisions,” Harvard 
company years before. This had perhaps clouded his judgment, business Review (February 2009), 60-66. 


which ultimately led to the demise of the company. 


= ~ Business researchers provide analyses of their own mental biases and stereotypes. Some of the 
and reports, but do decision makers biases include making decisions based upon an 
always listen and use that information? Recent overattachment to a particular plan, or even to a particular 
research provides evidence that regardless of the person. Other biases can include stereotypes about the 
“facts,” senior executives can make bad judgments, even when importance of speed in making decisions, and an overreliance 
they are seeking to improve their company. on emotion in making a decision. When making judgments, 
An Wang, CEO of Wang Laboratories, headed a company your brain can “trip you up,” by causing you to see patterns in 
that dominated the computer word processing market. the results that are not there, or when you use your past experi- 
~ Despite clear and convincing evidence, he felt compelled to ences to see the results you wish to see. Recognizing your own 
= build a computer using a proprietary operating system, cognitive shortcomings can be an important step towards 
z despite IBM’s PC dominance at the time, and the fact that avoiding a bad decision. 
Microsoft had developed the primary operating system and 
à not IBM. What drove this decision? Wang had a long distrust Source: Campbell, Andrew, Jo Whitehead, 
8 of IBM, which dated back to his own personal dislike for the and Syndey Finkelstein, “Why Good 
o 
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INTUITIVE DECISION MAKING 


The fact of the matter is that managers are decision makers. They are action-oriented, and they 
often rely on gut reaction and intuition. Many times their intuition serves them well, so it isn’t 
surprising that they sometimes do not believe a research project will help improve their decision 
making. At other times, they resist research because it just may provide information that is counter 
to their intuition or their desires. They particularly abhor being held back while waiting for some 
research report. 

If managers do use research, they often request simple projects that will provide concrete results 
with certainty. Researchers tend to see problems as complex questions that can be answered only 
within probability ranges. One aspect of this conflict is the fact that a research report provides find- 
ings, but cannot make decisions. Decision-oriented executives may unrealistically expect research 
to make decisions for them or provide some type of guarantee that the action they take will be 
correct. While research provides information for decision making, it does not always remove all 
the uncertainties involved in complex decisions. Certain alternatives may be eliminated, but the 
research may reveal new aspects of a problem. Although research is a valuable decision-making 
tool, it does not relieve the executive of the decision-making task. 

Presentation of the right facts can be extremely useful. However, decision makers often 
believe that researchers collect the wrong facts. Many researchers view themselves as technicians 
who generate numbers using sophisticated mathematical and statistical techniques; they may spend 
more time on technical details than on satisfying managerial needs. Each person who has a nar- 
row perspective of another’s job is a partial cause of the problem of generating limited or useless 
information. 

Consider this situation: An Internet retailer (Send.com) used a television ad to try to stimulate 
more gift purchasing among its customers. The spot centers on several men on the golf course 
drinking champagne. The “punch line” comes when one of the guys is hit in the groin. The voice 
over exclaims, “He just got hit in the little giver!” 

A male executive may like punch lines like this. However, the audience for these ads is not 
all male. Had research been used to test these ideas prior to spending the money to produce the 
ads and buy the spots, it would have revealed that men didn’t respond as favorably as expected 
to these ads and women found them boorish.* Thus, intuition has its limits as a replacement for 
informed research intelligence.’ 
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FUTURE DECISIONS BASED ON PAST EXPERIENCE 


Managers wish to predict the future, but researchers measure only current or past events. In 1957, 
Ford introduced the Edsel, one of the classic business failures of all time. One reason for the Edsel’s 
failure was that the research conducted several years before the car’s introduction indicated a strong 
demand for a medium-priced car for the “man on his way up.” By the time the car was introduced, 
however, consumer preference had shifted to two cars, one being a small import for the suburban 
wife. Not all research information is so dated, but all research describes what people have done 
in the past. In this sense, researchers use the past to predict the future. As seen in the preceding 
Research Snapshot, experiences can affect how decision makers see results. 


Reducing the Conflict between 
Management and Researchers 


Given the conflicting goals of management and research, it is probably impossible to completely 
eliminate the conflict. However, when researchers and decision makers work more closely 
together, there will be less conflict. The more closely they work together, the better the com- 
munication between decision makers and researchers. In this way, business decision makers will 
better understand the information needs and work requirements of researchers. It will allow for 
better planning of research projects and a greater appreciation for the role that research plays in 
minimizing the riskiness of business decision making. Exhibit 5.4 lists some common areas of 


Areas of Conflict between Top Management and Marketing Researchers 


Area of Potential 
Conflict 


Research responsibility 


Research personnel 


Budget 


Assignments 


Problem definition 


Research reporting 


Use of research 


Top Management's Position 


Researchers lack a sense of accountability. The 
sole function of the researcher is to provide 
information. 


Researchers are generally poor communicators 
who lack enthusiasm, skills, and imagination. 


Research costs too much. Since the research 
department's contribution is difficult to measure, 
budget cuts in the department are defensible. 


Projects tend to be overengineered and not 
executed with a sense of urgency. Researchers 
have a ritualized, staid approach. 


The researcher is best equipped to define the 
problem; it is sufficient for the top manager to 
give general direction. Top managers cannot 
help it if circumstances change. The researcher 
must appreciate this and be willing to respond 
to changes. 


Most reports are dull, use too much jargon and 


too many qualifiers, and are not decision oriented. 


Reports too often are presented after a decision 
has been made. 


Top managers should be free to use research as 
they see fit. Changes in the need for and timing of 
research are sometimes unavoidable. 


Business Researcher’s Position 


The responsibility for research should be 
explicitly defined, and this responsibility should 
be consistently followed. The researcher should 
be involved with top management in decision 
making. 


Top managers are anti-intellectual. Researchers 
should be hired, judged, and compensated on 
the basis of their research capabilities. 


“You get what you pay for.” Research must have 
a continuing, long-term commitment from top 
management. 


Top managers make too many nonresearchable or 
emergency requests and do not allocate sufficient 
time or money. 


Researchers are often not given all the relevant 
facts about situations, which often change after 
research is under way. Top managers are generally 
unsympathetic to this widespread problem. 


Top managers treat research reports superficially. 
Good research demands thorough reporting and 
documentation. Top managers give insufficient 
time to prepare good reports. 


Top managers’ use of research to support a 
predetermined position or to confirm or excuse 
past decisions represents misuse. Also, it is wasteful 
to request research and then not use 

it after it has been conducted. 


Based on John G. Keane, “Some Observations on Marketing Research in Top Management Decision Making,’ Journal of Marketing, October 1969, p. 13. 
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conflict between research and management. Many of these can be avoided through improved 
understanding of the other’s position. 

With closer cooperation, managers are more involved with projects from the beginning. Early 
involvement increases the likelihood that managers will accept and act on the results. Researchers’ 
responsibility should be made explicit by a formal job description. Better planning and an annual 
statement of the research program for the upcoming year will help minimize emergency assign- 
ments, which usually waste resources and demoralize personnel. 

Business researchers likewise will come to understand management’s perspective better. 
Researchers enhance company profits by encouraging better decisions. The closer together man- 
agers and researchers work, the more researchers realize that managers sometimes need infor- 
mation urgently. Thus, they should try to develop cost-saving research alternatives and realize 
that sometimes a quick-and-dirty study is necessary, even though it may not be as scientifically 
rigorous as might be desired. Sometimes, quick-and-dirty studies still provide usable and timely 
information. In other words, they should focus on results. 

Perhaps most important is more effective communication of the research findings and 
research designs. The researchers must understand the interests and needs of the users of the 
research. If the researchers are sensitive to the decision-making orientation of management 
and can translate research performance into management language, organizational conflict will 
diminish. 

A research generalist can effectively serve as a link between management and the research 
specialist. The research generalist acts as a problem definer, an educator, a liaison, a communicator, 
and a friendly ear. This intermediary could work with specialists who understand management’s 
needs and demands. The student with research skills who has a business degree seems most suited 
for this coordinating function. 

Several strategies for reducing the conflict between management and research are possible. 
Managers generally should plan the role of research better, and researchers should become more 
decision-oriented and improve their communication skills (see Exhibit 5.5 on the next page).* 


Cross-Functional Teams 


The ability to develop a successful decision making approach is often a function of the input of 
many different stakeholders. With improved communication, a more focused solution is possible. 
One way to encourage this is through cross-functional teams. 

Cross-functional teams are composed of individuals from various functional areas such as 
engineering, production, finance, and marketing who share a common purpose. Cross-functional 
teams help organizations focus on a core business process, such as customer service or new- 
product development. Working in teams reduces the tendency for employees to focus single- 
mindedly on an isolated functional activity. Cross-functional teams help employees increase 
customer value since communication about their specific desires and opinions are better com- 
municated across the firm. 

At trendsetting organizations, many research directors are members of cross-functional 
teams. New-product development, for example, may be done by a cross-functional team of 
engineers, finance executives, production personnel, marketing managers, and staff research- 
ers who take an integrated approach to solve a problem or exploit opportunities. In the 
old days, research may not have been involved in developing new products until long after 
many key decisions about product specifications and manufacturing had been made. Now 
researchers’ input is part of an integrated team effort. Researchers act both as business consul- 
tants and as providers of technical services. Researchers working in teams are more likely to 
understand the broad purpose of their research and less likely to focus exclusively on research 
methodology. 

The effective cross-functional team is a good illustration of the business research concept in 
action. It reflects an effort to satisfy customers by using all the organization’s resources. Cross- 
functional teams are having a dramatic impact on views of the role of business research within the 
organization. 
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research generalist 


An employee who serves as a 
link between management and 
research specialists. The research 
generalist acts as a problem 
definer, an educator, a liaison, a 
communicator, and a friendly ear. 


cross-functional teams 


Employee teams composed of 
individuals from various func- 
tional areas such as engineer- 
ing, production, finance, and 
marketing who share a common 
purpose. 
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EXHIBIT 5.5 
Improving Two-Way 
Communication to 
Reduce Conflict 


research suppliers 


Commercial providers of 
research services. 


syndicated service 


A research supplier that provides 
standardized information for 
many clients in return for a fee. 
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Effectively Communicate 
Research Results 


Recognize Time Constraints 


Provide Methodology of 
Consistent Quality 


Communicate Research 
Point of View 


Ensure That Information Needs 
Are Jointly Determined 


Be Decision-Oriented, 
Not Technique-Oriented 


Reflect Management 
Viewpoint 


Treat Management 
as a Client 


Research Suppliers and Contractors 


As mentioned in the beginning of the chapter, there are times when it makes good sense to obtain busi- 
ness research from an outside organization. In these cases, managers must interact with research suppliers, 
who are commercial providers of business and marketing research services. Business research is carried 
out by firms that may be variously classified as marketing and business research consulting companies, 
such as Burke, Market Facts, Inc., or Freedonia, Inc.; suppliers of syndicated research services, such as 
Roper Starch Worldwide; as well as interviewing agencies, universities, and government agencies. 


Syndicated Service 


No matter how large a firm’s research department is, some projects are too expensive to perform 
in-house. A syndicated service is a research supplier that provides standardized information for 
many clients in return for a fee. They serve as a sort of supermarket for standardized research 
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Finding Haagen-Dazs in China 
~ Ice cream lovers needn't worry if they 
are sent on a business trip to China. 
Häagen-Dazs ice cream shops first appeared in 
Shanghai, China, in 1996 and now there are dozens 
of Haagen-Dazs ice cream shops in coastal China, with plans for 
hundreds more. Clearly, many firms would like to follow Haagen- 
Dazs into China. China is expected to be the world’s largest 
consumer market by 2020. However, where should an ice cream 
shop be located in China? While location decisions can be difficult 
enough within the borders of one’s own country, imagine trying 
to decide where to put a shop in a huge, unfamiliar country. 
Fortunately, standardized research companies like Retail 
Forward have resources deployed all around the world that can 
synthesize Geographic Information System (GIS) information 
with survey research and other information to assist firms with 


results. For example, J. D. Power and Associates sells research about customers’ ratings of automo- 
bile quality and their reasons for satisfaction. Most automobile manufacturers and their advertising 
agencies subscribe to this syndicated service because the company provides important industry-wide 
information it gathers from a national sample of thousands of car buyers. By specializing in this type 
of customer satisfaction research, J. D. Power gains certain economies of scale. 


location decisions in China and in other developing countries. 
Since U.S.-based retail firms may lack the necessary connections 
and knowledge (expertise) to efficiently conduct research in 
faraway places, the use of an outside research provider not only 
saves time and money, but also yields higher quality results than 
an in-house study. Imagine how difficult language barriers could 
be when dealing with the Chinese consumer market. 

And, as difficult as identifying good retail locations seems in 
China, other top emerging retail nations include India, Russia, and 
the Ukraine. As in China, American and European firms may find 
that using a research supplier to help with retail location issues in 
these countries is wiser than doing the research themselves. 


Sources: “Haagen-Dazs in China,’ China 
Business Review 31 (Jul/Aug 2004), 22; 
Hall, Cecily, “Spanning the Retail Globe,” 
WWD: Women’s Wear Daily 190 (July 21 
2005), 11. 


standardized research 
service 


Companies that develop a 
unique methodology for investi- 
gating a business specialty area. 


Syndicated services can provide expensive information economically to numerous clients because 


the information is not specific to one client but interests many. Such suppliers offer standardized infor- 
mation to measure media audiences, wholesale and retail distribution data, and other forms of data. 


Standardized Research Services 


Standardized research service companies develop a unique meth- 
odology for investigating a business specialty area. Several 
research firms, such as Retail Forward (http://www.retailforward. 
com), provide location services for retail firms. The Research 
Snapshot above illustrates an interesting application for which an 
outside location service company may be particularly useful. 
Research suppliers conduct studies for multiple, individual cli- 
ents using the same methods. 

ACNielsen 
throughout the new-product development process, from initial 


(http://www.acnielsen.com) collects information 
concept screening through test-marketing. The BASES system 
can evaluate initiatives relative to other products in the competi- 
tive environment. For example, a client can compare its day- 
after recall scores with average scores for a product category. 
Even when a firm could perform the research task in-house, 
research suppliers may be able to conduct the project at a lower 
cost, faster, and relatively more objectively. A company that 
wishes to quickly evaluate a new advertising strategy may find 
an ad agency’s research department is able to provide technical 
expertise on copy development research that is not available 
within the company itself. Researchers may be well advised to 
seek outside help with research when conducting research in a 
foreign country in which the necessary human resources and 


Doing research in a foreign 
country is often better done 
by an outside agency with 
resources in those places. 
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custom research 


Research projects that are 
tailored specifically to a client's 
unique needs. 


business ethics 


The application of morals to 
behavior related to the exchange 
environment. 


moral standards 


Principles that reflect beliefs 
about what is ethical and what is 
unethical. 


ethical dilemma 


Refers to a situation in which one 
chooses from alternative courses 
of actions, each with different 
ethical implications. 


Part 1: Introduction 


knowledge to effectively collect data are lacking. The preceding Research Snapshot illustrates 
this situation. 


Limited Research Service Companies 
and Custom Research 


Limited-service research suppliers specialize in particular research activities, such as syndicated 
service, field interviewing, data warehousing, or data processing. Full-service research suppliers 
sometimes contract these companies for ad hoc research projects. The client usually controls these 
agencies or management consulting firms, but the research supplier handles most of the operating 
details of custom research projects. These are projects that are tailored specifically to a client’s 
unique needs. A custom research supplier may employ individuals with titles that imply relation- 
ships with clients, such as account executive or account group manager, as well as functional specialists 
with titles such as statistician, librarian, director of field services, director of tabulation and data processing, 
and interviewer. 

Exhibit 5.6 lists the top 25 suppliers of global marketing research and their revenues in 2008. 
Most provide various services ranging from designing activities to fieldwork. The services they can 
provide are not covered in detail here because they are discussed throughout the book, especially 
in the sections on fieldwork. However, here we briefly consider some managerial and human 
aspects of dealing with research suppliers. Clearly, the exhibit reveals that research is big business. 
Its growth will continue as data availability increases and as businesses desire more precision in 
their decision making. Therefore, attractive career opportunities are numerous for those with the 
right skills and desires. 


Ethical Issues in Business Research 


As in all human interactions, ethical issues exist in research. Our earlier discussion of potential 
organizational politics and the implication of different goals or perspectives introduced a situation 
where ethics can come into play. This book considers various ethical issues concerning fair busi- 
ness dealings, proper research techniques, and appropriate use of research results in other chapters. 
The remainder of this chapter addresses society’s and managers’ concerns about the ethical impli- 
cations of business research. 


Ethical Questions Are Philosophical Questions 


Ethical questions are philosophical questions. There are several philosophical theories that address 
how one develops a moral philosophy and how behavior is affected by morals. These include the- 
ories about cognitive moral development, the bases for ethical behavioral intentions, and opposing 
moral values. While ethics remain a somewhat elusive topic, what is clear is that not everyone 
involved in business, or in fact involved in any human behavior, comes to the table with the same 
ethical standards or orientations.° 

Business ethics is the application of morals to behavior related to the business environment or 
context. Generally, good ethics conforms to the notion of “right,” and a lack of ethics conforms 
to the notion of “wrong.” Highly ethical behavior can be characterized as being fair, just, and 
acceptable.’ Ethical values can be highly influenced by one’s moral standards. Moral standards are 
principles that reflect beliefs about what is ethical and what is unethical. More simply, they can be 
thought of as rules distinguishing right from wrong. The Golden Rule, “Do unto others as you 
would have them do unto you,” is one such ethical principle. 

An ethical dilemma simply refers to a situation in which one chooses from alternative 
courses of actions, each with different ethical implications. Each individual develops a phi- 
losophy or way of thinking that is applied to resolve the dilemmas they face. Many people use 
moral standards to guide their actions when confronted with an ethical dilemma. Others 
adapt an ethical orientation that rejects absolute principles. Their ethics are based more on 
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Top 25 Global Marketing Research Firms 


Organization Headquarters Web Site Employees 
The Nielsen Co. New York, NY nielsen.com 33,171 
IMS Health Inc. Norwalk, CT imshealth.com 7,950 
Taylor Nelson Sofres plc London, UK tnsglobal.com 15,267 
GfK AG Nuremberg, Germany gfk.com 9,070 
The Kantar Group London, UK kantargroup.com 7,100 
Ipsos Group SA Paris, France ipsos.com 8,088 
Synovate London, UK synovate.com 5,801 
IRI Chicago, IL infores.com 3,655 
Westat, Inc. Rockville, MD westat.com 1,906 
Arbitron, Inc. New York, NY arbitron.com 1,130 
INTAGE Inc. Tokyo, Japan intage.co.jp 1,666 
J. D. Power and Associates Westlake Village, CA jdpa.com 875 
Harris Interactive Inc. Rochester, NY harrisinteractive.com 1,336 
Maritz Research Fenton, MA maritzresearch.com 806 
The NPD Group Inc. Port Washington, NY npd.com 1,120 
Opinion Research Omaha, NE infousa.com 1,235 
Video Research, Ltd. Tokyo, Japan videor.co.jp 386 
IBOPE Group Sao Paulo, Brazil ibope.com.br 1,743 
Lieberman Research Los Angeles, CA Irwonline.com 324 
comScore Inc. Reston, VA comscore.com 452 
Cello Research London, UK cellogroup.co.uk 400 
Market Strategies, Intl. Livoria, MI marketstrategies.com 311 
BVA Group Paris, France bva.fr 620 
OTX Los Angeles, CA otxresearch.com 191 
Dentsu Research, Inc. Tokyo, Japan dentsuresearch.co.jp 116 


Source: Marketing News (August 15, 2008), vol. 43 (13): H4—H50. 


the social or cultural acceptability of behavior. If it conforms to social or cultural norms, 
then it is ethical. From a moral theory standpoint, idealism is a term that reflects the degree 
to which one accepts moral standards as a guide for behavior. Relativism is a term that reflects 
the degree to which one rejects moral standards in favor of the acceptability of some action. 
This way of thinking rejects absolute principles in favor of situation-based evaluations. Thus, 
an action that is judged ethical in one situation can be deemed unethical in another. In con- 
trast, idealism is a term that reflects the degree to which one bases one’s morality on moral 
standards. Someone who is an ethical idealist will try to apply ethical principles like the 
golden rule in all ethical dilemmas. 

For example, a student may face an ethical dilemma when taking a test. Another student may 
arrange to exchange multiple choice responses to a test via electronic text messages. This repre- 
sents an ethical dilemma because there are alternative courses of action each with differing moral 


Revenue ($M) 


$4,220.0 
2,192.6 
2,137.2 
1,593.2 
1,551.4 
1,270.3 
867.0 
702.0 
467.8 
352.1 
281.1 
260.5 
226.8 
223.3 
211.1 
202.2 
169.6 
116.5 
87.5 
87.2 
79.9 
61.8 
55.6 
54.5 


54.2 


relativism 
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A term that reflects the degree 


to which one rejects moral 


standards in favor of the accept- 
ability of some action. This way 

of thinking rejects absolute prin- 
ciples in favor of situation-based 


evaluations. 


idealism 


A term that reflects the degree to 
which one bases one’s morality 


on moral standards. 
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HIBIT 
Interaction of Rights and 
Obligations between Parties 


informed consent 


When an individual understands 
what the researcher wants him 
or her to do and consents to the 
research study. 
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implications. An ethical idealist may apply a rule that cheating is always wrong and therefore 
would not be likely to participate in the behavior. An ethical relativist may instead argue that the 
behavior is acceptable because a lot of the other students will be doing the same. In other words, 
the consensus is that this sort of cheating is acceptable, so this student would be likely to go ahead 
and participate in the behavior. Researchers and business stakeholders face ethical dilemmas prac- 
tically every day. The following sections describe how this can occur. 


General Rights and Obligations of Concerned Parties 


Everyone involved in business research can face an ethical dilemma. For this discussion, we can 
divide those involved in research into three parties: 


1. The people actually performing the research, who can also be thought of as the “doers” 

2. The research client, sponsor, or the management team requesting the research, who can be 
thought of as “users” of research 

3. The research participants, meaning the actual research respondents or subjects 


Each party has certain rights and obligations toward the other parties. Exhibit 5.7 diagrams these 
relationships. 


Research Participant's Rights Client's Rights 


Researcher's Obligations Researcher's Obligations 


Subject Researcher Client 


Researcher's Rights Researcher's Rights 


Subject’s Obligations Client's Obligations 


Subject’s Rights 


Client's Obligations 


Like the rest of business, research works best when all parties act ethically. Each party depends 
on the other to do so. A client depends on the researcher to be honest in presenting research 
results. The researcher depends on the client to be honest in presenting the reasons for doing the 
research and in describing the business situation. Each is also dependent on the research partici- 
pant’s honesty in answering questions during a research study. Thus, each is morally obligated 
toward the other. Likewise, each also has certain rights. The following section elaborates on the 
obligations and rights of each party. 


Rights and Obligations of the Research Participant 


Most business research is conducted with the research participant’s consent. In other words, the 
participation is active. Traditional survey research requires that a respondent voluntarily answer 
questions in one way or another. This may involve answering questions on the phone, respond- 
ing to an e-mail request, or even sending a completed questionnaire by regular mail. In these 
cases, informed consent means that the individual understands what the researcher wants him or 
her to do and consents to the research study. In other cases, research participants may not be 
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aware that they are being monitored in some way. For instance, a research firm may monitor 
superstore purchases via an electronic scanner. The information may assist in understanding how 
customers respond to promotions. However, no consent is provided since the participant is par- 
ticipating passively. The ethical responsibilities vary depending on whether participation is active 
or passive. 


THE OBLIGATION TO BE TRUTHFUL 


When someone willingly consents to participate actively, it is generally expected that he or she 
will provide truthful answers. Honest cooperation is the main obligation of the research partici- 
pant. In return for being truthful, the subject has the right to expect confidentiality. Confidentiality 
means that information involved in the research will not be shared with others. When the respon- 
dent truly believes that confidentiality will be maintained, then it becomes much easier to respond 
truthfully, even about potentially sensitive topics. Likewise, the researcher and the research sponsor 
also may expect the respondent to maintain confidentiality. For instance, if the research involves 
a new food product from Nabisco, then they may not want the respondent to discuss the idea for 
fear that the idea may fall into the competition’s hands. Thus, confidentiality is a tool to help 
ensure truthful responses. 


PARTICIPANT’S RIGHT TO PRIVACY 


Active Research 

Most people relish their privacy. Hence, the right to privacy is an important issue in business 
research. This issue involves the participant’s freedom to choose whether to comply with 
the investigator’s request. Traditionally, researchers have assumed that individuals make an 
informed choice. However, critics have argued that the old, the poor, the poorly educated, and 
other underprivileged individuals may be unaware of their right to choose. They have further 
argued that an interviewer may begin with some vague explanation of a survey’s purpose, 
initially ask questions that are relatively innocuous, and then move to questions of a highly 
personal nature. It has been suggested that subjects be informed of their right to be left alone 
or to break off the interview at any time. Researchers should not follow the tendency to “hold 
on” to busy respondents. However, this view definitely is not universally accepted in the 
research community. 

The privacy issue is illustrated by these questions: 


e “Ts a telephone call that interrupts family dinner an invasion of privacy?” 
e “Ts an e-mail requesting response to a 30-minute survey an invasion of privacy?” 


Generally, interviewing firms practice common courtesy by trying not to interview late in the 
evening or at other inconvenient times. However, the computerized random phone number 
interview has stimulated increased debate over the privacy issue. As a practical matter, respondents 
may feel more relaxed about privacy issues if they know who is conducting the survey. Thus, it 
is generally recommended that field interviewers indicate that they are legitimate researchers and 
name the company they work for as soon as someone answers the phone. For in-person surveys, 
interviewers should wear official name tags and provide identification giving their name and the 
names of their companies. 

Research companies should adhere to the principles of the “do-not-call” policy and should 
respect consumers’ “Internet privacy.” Do-not-call legislation restricts any telemarketing effort 
from calling consumers who either register with a no-call list in their state or who request not to 
be called. Legislators aimed these laws at sales-related calls. However, legislation in several states, 
including California, Louisiana, and Rhode Island, has extended this legislation to apply to “those 
that seek marketing information.” Thus, the legislation effectively protects consumers’ privacy 
from researchers as well as salespeople.’ 

Consumers often are confused about the difference between telemarketing efforts and true 
marketing or business research. Part of this is because telemarketers sometimes disguise their sales 
efforts by opening the conversation by saying they are doing research. The resulting confusion 
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confidentiality 


The information involved in a 
research study will not be shared 
with others. 


do-not-call legislation 


Restricts any telemarketing effort 
from calling consumers who 
either register with a no-call list 
or who request not to be called. 
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spyware 
Software placed on a computer 
without consent or knowledge 
of the user. 
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contributes to both increased refusal rates and lower trust. In 1980, a public opinion poll found 
that 19 percent of Americans reported having refused to participate in a marketing survey within 
the past year. Today, that number approaches 50 percent. In 2001, only 40 percent of Americans 
either agreed or strongly agreed that marketers will protect their privacy. That number is down 
from 50 percent in 1995.” 

Companies using the Internet to do research also face legislative changes. Much of this legisla- 
tion is aimed at making sure consumers are properly notified about the collection of data and to 
whom it will be distributed. Researchers should make sure that consumers are given a clear and 
easy way to either consent to participation in active research or to easily opt out. Furthermore, 
companies should ensure that the information consumers send via the Internet is secure.'° 


Passive Research 

Passive research involves different types of privacy issues. Generally, it is believed that unobtrusive 
observation of public behavior in places such as stores, airports, and museums is not a serious inva- 
sion of privacy. This belief is based on the fact that the consumers are indeed anonymous in that 
they are never identified by name nor is any attempt made to identify them. They are “faces in the 
crowd.” As long as the behavior observed is typical of behavior commonly conducted in public, 
then there is no invasion of privacy. In contrast, recording behavior that is not typically conducted 
in public would be a violation of privacy. For example, hidden cameras recording people (without 
consent) taking showers at a health club, even if ultimately intended to gather information to help 
improve the shower experience, would be considered inappropriate. 

Technology has also created new ways of collecting data passively that have privacy implica- 
tions. Researchers are very interested in consumers’ online behavior. For instance, the paths that 
consumers take while browsing the Internet can be extremely useful in understanding what kinds 
of information are most valued by consumers. Much of this information can be harvested and 
entered into a data warehouse. Researchers sometimes have legitimate reasons to use this data, 
which can improve consumers’ ability to make wise decisions. In these cases, the researcher should 
gain the consumers’ consent in some form before harvesting information from their Web usage 
patterns. Furthermore, if the information will be shared with other companies, a specific consent 
agreement is needed. This can come in the form of a question to which consumers respond yes or 
no, as in the following example: 


From time to time, the opportunity to share your information with other companies arises and this could 
be very helpful to you in offering your desirable product choices. We respect your privacy, however, and if 
you do not wish us to share this information, we will not. Would you like us to share your information 
with other companies? 


e Yes, you can share the information 


e No, please keep my information private 


Not all of these attempts are legitimate. Most readers have probably encountered spyware on their 
home computer. Spyware is software that is placed on your computer without consent or knowl- 
edge while using the Internet. This software then tracks your usage and sends the information back 
through the Internet to the source. Then, based on these usage patterns, the user will receive push 
technology advertising, usually in the form of pop-up ads. Sometimes, the user will receive so 
many pop-up ads that the computer becomes unusable. The use of spyware is illegitimate because 
it is done without consent and therefore violates the right to privacy and confidentiality. 

Legislators are increasingly turning their attention to privacy issues in data collection. When 
children are involved, researchers have a special obligation to insure their safety. COPPA, the 
Children’s Online Privacy Protection Act, was enacted into U.S. federal law on April 12, 2000. It 
defines a child as anyone under the age of 13. Anyone engaging in contact with a child through 
the Internet is obligated to obtain parental consent and notification before any personal informa- 
tion or identification can be provided by a child. Therefore, a researcher collecting a child’s name, 
phone number, or e-mail address without parental consent is violating the law. While the law 
and ethics do not always correspond, in this case, it is probably pretty clear that a child’s personal 
information shouldn’t be collected. The Research Snapshot on the next page further explains how 
conducting research with children is ethically complex. 
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A Crazy Good! Have Fun, Play 
= ~ Games (and Buy Pop-Tarts)! 
The online marketing of products and 
services to children has expanded exponentially. 
In the past, television was the primary advertising 
medium used to attract kids’ interest. The idea behind market- 
ing to children on television was simple. Children would see 
advertised food as fun, which would encourage them to get their 
parents to buy the product. Several studies examining the ethi- 
cal aspects of television advertising to children have challenged 
whether this was an appropriate way to sell food. 
With the advent of the Internet and electronic gaming, 
advertising food products to children through online Web 


are being exposed to a sophisticated marketing tool that seeks 


to influence them (and ultimately their parents) into buying 
food products. Some ethical challenges in particular are the 


direct inducement to 
buy product, and the 
challenges of privacy 
protection for children. 
Long term, the ben- 
efits and downsides of 
online entertainment 
and the marketing of 
products and services 
to children are only 


sites has reached new levels of sophistication. For example, at now being understood. 
PopTarts.com kids can play online games, enter the “store”, and 
interactively create images. Is this simply an online entertainment 
site, or something more? 

Recent research indicates that these online sites contain 
“entertainment” that is also designed to communicate a care- 


ful message—and that children may not recognize that they 


Source: Moore, E. S. and V. J. 
Rideout, “The Online Marketing 
of Food to Children: Is It Just 
Fun and Games?” Journal of 
Public Policy & Marketing 26, no. 
2 (2007), 202-220. Reprinted 
by permission. 


DECEPTION IN RESEARCH DESIGNS AND 
THE RIGHT TO BE INFORMED 


Experimental Designs 

Experimental manipulations often involve some degree of deception. In fact, without some 
deception, a researcher would never know if a research subject was responding to the actual 
manipulation or to their perception of the experimental variable. This is why researchers some- 
times use a placebo. 

A placebo is a false experimental effect used to create the perception of a true effect. Imagine 
two consumers, each participating in a study of the effect of a new herbal supplement on hyper- 
tension. One consumer receives a packet containing the citrus-flavored supplement, which is 
meant to be mixed in water and drunk with breakfast. The other also receives a packet, but in this 
case the packet contains a mixture that will simply color the water and provide a citrus flavor. The 
second consumer also believes he or she is drinking the actual supplement. In this way, the psy- 
chological effect is the same on both consumers, and any actual difference in hypertension must 
be due to the actual herbs contained in the supplement. Interestingly, experimental subjects often 
display some placebo effect in which the mere belief that some treatment has been applied causes 
some effect. 

This type of deception can be considered ethical. Primarily, researchers conducting an experi- 
ment must generally (1) gain the willful cooperation of the research subject and (2) fully explain 
the actual experimental variables applied following the experiment’s completion. Every experi- 
ment should include a debriefing session in which research subjects are fully informed and pro- 
vided a chance to ask any questions that they may have about the experiment. 


Descriptive Research 

Researchers sometimes will even withhold the actual research questions from respondents in sim- 
ple descriptive research. A distinction can thus be made between deception and discreet silence. 
For instance, sometimes providing the actual research question to respondents is simply providing 
them more information than they need to give a valid response. A researcher may ask questions 
about the perceived price of a product when his or her real interest is in how consumers form 
quality impressions. 


placebo 


A false experimental effect 
used to create the percep- 


tion that some effect has been 


administered. 


debriefing 


Research subjects are fully 
informed and provided with a 


chance to ask any questions they 
may have about the experiment. 
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human subjects review 
committee 


Carefully reviews proposed 
research design to try to make 
sure that no harm can come to 
any research participant. 


Part 1: Introduction 


PROTECTION FROM HARM 


Researchers should do everything they can to make sure that research participants are not harmed 
by participating in research. Most types of research do not expose participants to any harm. How- 
ever, the researcher should consider every possibility. For example, if the research involves tasting 
food or drink, the possibility exists that a research participant could have a severe allergic reac- 
tion. Similarly, researchers studying retail and workplace atmospherics often manipulate odors by 
injecting certain scents into the air.'' The researcher is sometimes in a difficult situation. He or 
she has to somehow find out what things the subject is allergic to, without revealing the actual 
experimental conditions. One way this may be done is by asking the subjects to provide a list of 
potential allergies ostensibly as part of a separate research project. 

Other times, research may involve some potential psychological harm. This may come in the 
form of stress or in the form of some experimental treatment that questions some strongly held 
conviction. For instance, a researcher studying helping behavior may lead a subject to believe that 
another person is being harmed in some way. In this way, the researcher can see how much a 
subject can withstand before doing something to help another person. In reality, the other person 
is usually a research confederate simply pretending to be in pain. Three key questions that can 
determine whether a research participant is being treated unethically as a result of experimental 
procedures are: 


1. Has the research subject provided consent to participate in an experiment? 
2. Is the research subject to substantial physical or psychological trauma? 
3. Can the research subject be easily returned to his or her initial state? 


The issue of consent is tricky in experiments because the researcher cannot reveal exactly what the 
research is about ahead of time or the validity of the experiment will be threatened. In addition, 
experimental research subjects are usually provided some incentive to participate. We will have 
more on this later in the book, but ethically speaking, the incentives should always be noncoer- 
cive. In other words, a faculty member seeking volunteers should not withhold a student’s grade 
if he or she does not participate in an experiment. Thus, the volunteer should provide consent 
without fear of harm for saying no and with some idea about any potential risk involved. 

If the answer to the second question is yes, then the research should not be conducted. If the 
answer to the second question is no and consent is obtained, then the manipulation does not pre- 
sent an ethical problem, and the researcher can proceed. 

The third question is helpful in understanding how far one can go in applying manipulations 
to a research subject. If the answer to the third question is no, then the research should not be 
conducted. For example, researchers who seek to use hypnosis as a means of understanding prefer- 
ences may be going too far in an effort to arrive at an answer. If the hypnotic state would cause the 
participant severe trauma, or if he or she cannot be easily returned to the prehypnotic state, then 
the research procedure should not be used. If, for instance, the consumer makes a large number 
of purchases under hypnosis, going deeply into debt, returning him or her to the original state 
may be difficult. If so, the application of hypnosis is probably inappropriate. If the answer to this 
question is yes, then the manipulation is ethical. 

Many research companies and practically all universities now maintain a human subjects review 
committee. This is a committee that carefully reviews a proposed research design to try to make 
sure that no harm can come to any research participant. A side benefit of this committee is that it 
can also review the procedures to make sure no legal problems are created by implementing the 
particular design. This committee may go by some other name such as internal review board, but 
despite the name difference, the function remains to protect the company from doing harmful 
research. 


Rights and Obligations of the Researcher 


Research staff and research support firms should practice good business ethics. Researchers are 
often the focus of discussions of business ethics because of the necessity that they interact with 
the public. Several professional organizations have written and adopted codes of ethics for their 
researchers, including the American Marketing Association, the European Society for Opinion 
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and Market Research, and the Marketing Research Society.” For illustrative purposes, Exhibit 5.8 
presents the Code of Ethics of the American Marketing Association. 

In addition, the researchers have rights. In particular, once a research consulting firm is hired 
to conduct some research, they have the right to cooperation from the sponsoring client. In addi- 
tion, the researchers have the right to be paid for the work they do as long as it is done profession- 
ally. Sometimes, the client may not like the results. But not liking the results is no basis for not 
paying. In addition, the client should pay the researcher in full and in a timely manner. 


8 Code of Ethics of the American Marketing Association 


The American Marketing Association, in furtherance of its central employed will be made available upon request to the sponsor 
objective of the advancement of science in marketing and in of the research. Evidence that fieldwork has been completed 
recognition of its obligations to the public, has established these according to specifications will, upon request, be made available 
principles of ethical practice of marketing research for the guidance to buyers of research. 

of its members. 2. The identity of the survey sponsor and/or the ultimate client for 

In an increasingly complex society, marketing research is more whom a survey is being done will be held in confidence at all 
and more dependent upon marketing information intelligently times, unless this identity is to be revealed as part of the research 
and systematically obtained. The consumer is the source of much design. Research information shall be held in confidence by the 
of this information. Seeking the cooperation of the consumer research organization or department and not used for personal 
in the development of information, marketing management gain or made available to any outside party unless the client 
must acknowledge its obligation to protect the public from specifically authorizes such release. 
misrepresentation and exploitation under the guise of research. 3. A research organization shall not undertake studies for 

Similarly, the research practitioner has an obligation to the competitive clients when such studies would jeopardize the 
discipline he practices and to those who provide support for his confidential nature of client-agency relationships. 
practice—an obligation to adhere to basic and commonly accepted 
standards of scientific investigation as they apply to the domain of For Users of Marketing Research 
marketing research. : ; : 1. A user of research shall not knowingly disseminate conclusions 

It is the intent of this code to define ethical standards required of from a given research project or service that are inconsistent with 
marketing research in satisfying these obligations. i or not warranted by the data. 

Adherence to this code will assure the user of marketing research 2. To the extent that there is involved in a research project a unique 
that the research was done in accordance with acceptable ethical design involving techniques, approaches, or concepts not 
practices. Those engaged in research will find in this code an commonly available to research practitioners, the prospective user 
affirmation of sound and honest basic principles that have developed of research shall not solicit such a design from one practitioner 
over the years as the profession has grown. The field interviewers and deliver it to another for execution without the approval of the 
who are the points of contact between the profession and the design originator. 
consumer will also find guidance in fulfilling their vitally important 
ae For Field Interviewers 
For Research Users, Practitioners, and Interviewers 1. Research assignments and materials received, as well as 
1. No individual or organization will undertake any activity that is information obtained from respondents, shall be held in 

directly or indirectly represented to be marketing research, but confidence by the interviewer and revealed to no one except the 
that has as its real purpose the attempted sale of merchandise research organization conducting the marketing study. 
or services to some or all of the respondents interviewed in the 2. No information gained through a marketing research activity shall 
course of the research. be used, directly or indirectly, for the personal gain or advantage 
2. If a respondent has been led to believe, directly or indirectly, that of the interviewer. ree s 
he or she is participating in a marketing research survey and that his 3. Interviews shall be conducted in strict accordance with 
or her anonymity will be protected, the respondent's name shall specifications and instructions received. 
not be made known to anyone outside the research organization 4. An interviewer shall not carry out two or more interviewing 
or research department, or used for anything other than research assignments simultaneously unless authorized by all contractors 
purposes. or employers concerned. 
For Research Practitioners Members of the American Marketing Association will be expected to 
1. There will be no intentional or deliberate misrepresentation of conduct themselves in accordance with provisions of this code in all 
research methods or results. An adequate description of methods of their marketing research activities. 


“AMA Adopts New Code of Ethics,” Marketing News, September 11, 1987, pp. 1, 10. Reprinted with permission of the American Marketing Association. 


THE PURPOSE OF RESEARCH IS RESEARCH 


Mixing Sales and Research 

Consumers sometimes agree to participate in an interview that is purported to be pure research, but 
it eventually becomes obvious that the interview is really a sales pitch in disguise. This is unprofes- 
sional at best and fraudulent at worst. The Federal Trade Commission (FTC) has indicated that 
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Is It Right, or Is It Wrong? 
Sometimes, the application of research procedures to research 
participants can present significant ethical issues that cannot 

be easily dismissed by a single researcher alone. This is where a 
peer review process takes place. A human subjects research 
committee consists of a panel of researchers (and sometimes a 
legal authority) who carefully review the proposed procedures 
to identify any obvious or non-obvious ethical or legal issues. 

In fact, any research supported by U.S. federal funds must be 
subject to a peer review of this type. The peer review process for 
grants is described at this Web site: http://grants.nih.gov/grants/peer/ 
peer.htm. 

Most business research is innocuous and affords little oppor- 
tunity for substantial physical or psychological trauma. However, 
companies involved in food marketing, dietary supplements or 
programs, and exercise physiology and pharmaceuticals, among 
others, do conduct consumer research with such possibilities. 
Academic researchers also sometimes conduct research with sig- 
nificant risks for participants. Consider research examining how 
some dietary supplement might make exercise more enjoyable, 
thus creating a better overall health and psychological effect. 
Clearly, a peer review by knowledgeable researchers is needed 
before proceeding with such 


research. 

As it isn’t possible to com- 
pletely eliminate risk from 
research, a human subjects 


it is illegal to use any plan, scheme, or ruse that misrepresents the true status of a person seeking 
admission to a prospect’s home, office, or other establishment. No research firm should engage in 
any sales attempts. Applied market researchers working for the sponsoring company should also 
avoid overtly mixing research and sales. However, the line is becoming less clear with increasing 


technology. 


review is a good safety net. Deaths have 
been attributed to lack of or the breakdown 
of the human subjects review. Some of these 
have brought negative publicity to well- 
known universities including the University 

of Pennsylvania and Johns Hopkins University. 
At other times, the risk to research participants is not obvious. For 
example, recently several researchers were interested in survey- 
ing through personal interviews victims of Hurricane Katrina. The 
results of the research may help public entities better serve vic- 
tims, allow companies to respond with more appropriate goods 
and services, and help build psychological theory about how con- 
sumers make decisions under conditions of high personal trauma 
and stress. However, is it ethical to survey participants standing in 
the rubble of their home? Is it ethical to survey participants who 


are in the process of searching for or burying relatives that did not 


survive the disaster? Clearly, a thorough review of the procedures 
involved in such situations is called for. 

Corporate human subjects committees are also becoming com- 
mon. These reviews also consider the possibility of legal problems 
with experimental or survey procedures. In addition, as technology 
blurs the line between research and sales, they also should review 
the ethics of “research” that may somehow blend with sales. In addi- 
tion, research conducted on animals also needs a critical review. 


Sources: Glenn, David, “Lost (and Found) in the Flood,” Chronicle of Higher 
Education 52 (October 7, 2005), A14—A19; Putney, S. B. and S. Gruskin, “Time, Place 
and Consciousness: Three Dimensions of Meaning for U.S. Institutional Review 
Boards,” American Journal of Public Health 92 (July 2002), 1067-1071. 


Research That Isn’t Research 


Consider the vignette that opened this chapter. Despite her best efforts, Amy is clearly feeling 
pressure to justify certain results obtained from the employee survey, while ignoring others. It’s 
probably pretty easy to see what is actually going on. The manager really wants research that will 
justify a decision that already has been made. If the employees’ responses contradict the decision, 
the manager will almost certainly disregard the research. This isn’t really research so much as it is 


pseudo-research 


Conducted not to gather infor- 
mation for marketing decisions 
but to bolster a point of view and 
satisfy other needs. 


will be worth the rates they will charge advertisers, they may not have the hard evidence to sup- 
port this view. For example, an advertiser’s sales force may provide feedback indicating customer 
resistance to moving their advertising from local radio to the Internet. The advertising company 
may then commission a study for which the only result they care to find is that the Internet ads 
will be effective. In this situation, a researcher should walk away from the project if it appears 
that management strongly desires the research to support a predetermined opinion only. While it 
is a fairly easy matter for an outside researcher to walk away from such a job, it is another matter 
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pseudo-research because it is conducted not to gather information for decisions but to bolster a 
point of view and satisfy other needs. 

The most common type of pseudo-research 1s performed to justify a decision that has already 
been made or that management is already strongly committed to. A media company may wish 
to sell advertising space on Internet search sites. Even though they strongly believe that the ads 
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4 Health Club Memberships: 
~ Good for Business, but Bad 
Ethically? 
Is it a good idea to have your customers hate you? 
For certain industries, providing difficult or mis- 
leading information regarding membership is not only used, but 
is quite profitable. 


membership fees, and so despite the size of the customer dissat- 
isfaction it is an accepted business practice. The creation of dif- 
ficult or confusing membership plans can lead to poor decisions 
by customers, yet it is these very plans that are the most profit- 
able. This can represent a real ethical challenge to organizational 
leaders of these firms: Do you continue to mislead clients to max- 
imize profits, or do you add value through disclosure and reduce 


Recent data regarding the health club industry in New York profitability? 


suggests that 41 percent of the health clubs did not explain 
their fees in writing, and over 95 percent did not inform health 
club patrons of all the ways to legally cancel a contract. As a 
result, health club membership complaints rank within the top 
1 percent based upon the volume of complaints through the 
U.S. Better Business Bureau. The health club business is built on 


Source: Mcgovern, 

G. and Y. Moon, 
“Companies and the 
Customers Who Hate 
Them,” Harvard Business 
Review (June 2007): 
78-84. 
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for an in-house researcher to refuse such a job. Thus, avoiding pseudo-research is a right of the 
researcher but an obligation for the manager. 

Occasionally, research is requested simply to pass blame for failure to another area. A product 
manager may deliberately request a research study with no intention of paying attention to the 
findings and recommendations. The manager knows that the particular project is in trouble but 
plays the standard game to cover up for his or her mismanagement. If the project fails, marketing 
research will become the scapegoat. The ruse may involve a statement something like this: “Well, 
research should have identified the problem earlier!” 

Also, technology is making the line between research and sales less clear. It is very likely that 
research data collected by companies we transact with online could be used to push products 
toward us that we may truly like. This is the point of push technology. What makes this ethical or 
not ethical? With consent, it is clearly ethical. What other ethical challenges may be faced as the 
technology to collect consumer information continues to develop? 


Push Polls 

Politicians have concocted a particular type of pseudo-research as a means of damaging opposing 
candidates’ reputations. A push poll is telemarketing under the guise of research. Its name derives 
from the fact that the purpose of the poll is to push consumers into a predetermined response. For 
instance, thousands of potential voters can be called and asked to participate in a survey. The 
interviewer then may ask loaded questions that put a certain spin on a candidate. 


Service Monitoring 

Occasionally, the line between research and customer service isn’t completely clear. For instance, 
Toyota may survey all of its new car owners after the first year of ownership. While the survey 
appears to be research, it may also provide information that could be used to correct some issue 
with the customer. For example, if the research shows that a customer is dissatisfied with the way 
the car handles, Toyota could follow up with the specific customer. The follow-up could result 
in changing the tires of the car, resulting in a smoother and quieter ride, as well as a more satisfied 
customer. Should a pattern develop showing other customers with the same opinion, Toyota may 
need to switch the original equipment tires used on this particular car. 

In this case, both research and customer service is involved. Since the car is under warranty, 
there would be no selling attempt. Researchers are often asked to design satisfaction surveys. 
These may identify the customer so they may be contacted by the company. Such practice is 
acceptable as long as the researcher allows the consumer the option of either being contacted or 
not being contacted. In other words, the customer should be asked whether it is okay for someone 


push poll 


Telemarketing under guise of 
research. 
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to follow up in an effort to improve their satisfaction. There are actually situations in which a 
customer could be made more satisfied by purchasing a less profitable product, as described by the 
preceding Research Snapshot. 

Push polls, selling under the guise of research, and pseudo-research are all misrepresentations 
of the true purpose of research and should be avoided. It is important that researchers understand 
the difference between research and selling. 


OBJECTIVITY 


The need for objective scientific investigation to ensure accuracy is stressed throughout this book. 
Researchers should maintain high standards to be certain that their data are accurate. Furthermore, 
they must not intentionally try to prove a particular point for political purposes. 


MISREPRESENTATION OF RESEARCH 


It should go without saying, but research results should not be misrepresented. This means, 
for instance, that the statistical accuracy of a test should be stated precisely and the meaning 
of findings should not be understated or overstated. Both the researcher and the client share 
this obligation. There are many ways that research results can be reported in a less than full 
and honest way. For example, a researcher may present results showing a relationship between 
advertising spending and sales. However, the researcher may also discover that this relation- 
ship disappears when the primary competitors’ prices are taken into account. In other words, 
the relationship between advertising spending and sales is made spurious by the competitors’ 
prices. Thus, it would be questionable to say the least to report a finding suggesting that sales 
could be increased by increasing ad spending without also mentioning the spurious nature of 
this finding. 


Honesty in Presenting Results 
Misrepresentation can also occur in the way results are presented. For instance, charts can be cre- 
ated that make a very small difference appear very big. Likewise, they can be altered to make a 
meaningful difference seem small. Exhibit 5.9 illustrates this effect. Each chart presents exactly the 
same data. The data represent consumer responses to service quality ratings and satisfaction rat- 
ings. Both quality and satisfaction are collected on a 5-point strongly-disagree-to-strongly-agree 
scale. In frame A, the chart appears to show meaningful differences between men and women, 
particularly for the service-quality rating. However, notice that the scale range is shown as 4 to 5. 
In frame B, the researcher presents the same data but shows the full scale range (1 to 5). Now, the 
differences are reported as trivial. 

All charts and figures should reflect fully the relevant range of values reported by respondents. 
If the scale range is from 1 to 5, then the chart should reflect a 1 to 5 range unless there is some 
value that is simply not used by respondents. If no or only a very few respondents had reported 
a 1 for their service quality or satisfaction rating, then it may be appropriate to show the range as 
2 to 5. However, if there is any doubt, the researcher should show the full scale range. 


Honesty in Reporting Errors 

Likewise, any major error that has occurred during the course of the study should not be kept 
secret from management or the sponsor. Hiding errors or variations from the proper procedures 
tends to distort or shade the results. Similarly, every research design presents some limitations. 
For instance, the sample size may be smaller than ideal. The researcher should point out the key 
limitations in the research report and presentation. In this way, any factors that qualify the find- 
ings can be understood. The decision maker needs this information before deciding on any risky 
course of action. 


CONFIDENTIALITY 


Confidentiality comes into play in several ways. The researcher often is obligated to protect the 
confidentiality of both the research sponsor and the research participant. In fact, business clients 
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EXHIBIT 5.9 

How Results Can Be 
Misrepresented in a Report 
or Presentation 


Æ Men 
Œ Women 
Quality* Satisfaction* 
A) Researcher points to a “large” difference in quality ratings. 
Men report much higher quality service than do women. In 
contrast, women report only “slightly” less satisfaction 
than do men. 
Œ Men 
Œ Women 


Quality* Satisfaction* 


B) The researcher points to a “trivial” difference in quality per- 
ceptions between men and women. There is no difference in 
the satisfaction ratings of men and women. 


value researchers’ confidentiality more than any other attribute of a research firm.” Imagine a 
researcher conducting a test-market for a new high-tech Apple iPod device that allows interactive 
video. Just after conducting the research, the same researcher is contacted by Samsung. Samsung, 
which has yet to develop video capability, wants research that addresses whether or not there is 
a market for iPod video of any type. The researcher is now in a difficult position. Certainly, an 
ethical dilemma exists presenting multiple choices to the researcher, including 


e Agreeing to do the research for Samsung and using some results from the Apple study to pre- 
pare a report and recommendation for Samsung 

e Agreeing to sell the new concept to Samsung without doing any additional research. In other 
words, provide Apple’s company secrets to Samsung 

e Conducting an entirely new project for Samsung without revealing any of the results or ideas 
from the Apple study 

e Turning down the chance to do the study without revealing any information about Apple to 
Samsung 
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Which is the best choice? Obviously, both of the first two options violate the principle of 
maintaining client confidentiality. Thus, both are unethical. The third choice, conducting an 
entirely new study, may be an option. However, it may prove nearly impossible to do the entire 
project as if the Apple study had never been done. Even with the best of intentions, the researcher 
may inadvertently violate confidentiality with Apple. The last choice is the best option from a 
moral standpoint. It avoids any potential conflict of interest. In other words, actions that would 
best serve one client, Samsung, would be detrimental to another client, Apple. Generally, it is best 
to avoid working for two direct competitors. 

Likewise, the researcher must also predict any confidentiality agreement with research par- 
ticipants. For instance, a researcher conducting a descriptive research survey may have identi- 
fied each participant’s e-mail address in the course of conducting the research. After seeing the 
results, the client may ask for the e-mail addresses as a logical prospect list. However, as long 
as the researcher assured each participant’s confidentiality, the e-mail addresses cannot ethically 
be provided to the firm. Indeed, a commitment of confidentiality also helps build trust among 
survey respondents.'* 


DISSEMINATION OF FAULTY CONCLUSIONS 


The American Marketing Association’s marketing research Code of Ethics states that “a user of 
research shall not knowingly disseminate conclusions from a given research project or service that 
are inconsistent with or not warranted by the data.” A dramatic example of a violation of this 
principle occurred in an advertisement of a cigarette smoker study. The advertisement compared 
two brands and stated that “ 
advertised brand to a competing brand. The misleading portion of this reported result was that 


of those expressing a preference, over 65 percent preferred” the 


most of the respondents did not express a preference; they indicated that both brands tasted about 
the same. Thus, only a very small percentage of those studied actually revealed a preference, and 
the results were somewhat misleading. Such shading of results violates the obligation to report 
accurate findings. 


Rights and Obligations of the Client Sponsor (User) 
ETHICAL BEHAVIOR BETWEEN BUYER AND SELLER 


The general business ethics expected between a purchasing agent and a sales representative should 
hold in a marketing research situation. For example, if a purchasing agent has already decided 
to purchase a product from a friend, it would be unethical for that person to solicit competi- 
tive bids from others because they have no chance of being accepted. Similarly, a client seeking 
research should only seek bids from firms that have a legitimate chance of actually doing the 
work. In addition, any section on the ethical obligation of a research client would be remiss not 
to mention that the user is obligated to pay the provider the agreed upon wage and pay within 
the agreed upon time. 


AN OPEN RELATIONSHIP WITH RESEARCH SUPPLIERS 


The client sponsor has the obligation to encourage the research supplier to objectively seek out the 
truth. To encourage this objectivity, a full and open statement of the decision situation, a full dis- 
closure of constraints in time and money, and any other insights that assist the researcher should be 
provided. This means that the researcher will be provided adequate access to key decision makers. 
These decision makers should agree to openly and honestly discuss matters related to the situation. 
Finally, this means that the client is open to actually using the research results. Time is simply too 
valuable to ask a researcher to perform a project when the results will not be used. 


AN OPEN RELATIONSHIP WITH INTERESTED PARTIES 


Conclusions should be based on data—not conjecture. Users should not knowingly disseminate 
conclusions from a research project in a manner that twists them into a position that cannot be 
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supported by the data. Twisting the results in a self-serving manner or to support some political 
position poses serious ethical questions. A user may also be tempted to misrepresent results while 
trying to close a sale. Obviously, this is also morally inappropriate. 

Advocacy research—tresearch undertaken to support a specific claim in a legal action or to 
represent some advocacy group—puts a client in a unique situation. Researchers often conduct 
advocacy research in their role as an expert witness. For instance, a researcher may be deposed to 
present evidence showing that a “knock-off” brand diminishes the value of a better known name 
brand. In conventional research, attributes such as sample size, profile of people actually inter- 
viewed, and number of questions asked are weighed against cost in traditional research. However, 
a court’s opinion on whether research results are reliable may be based exclusively on any one 
specific research aspect. Thus, the slightest variation from technically correct procedures may be 
magnified by an attorney until a standard research result or project no longer appears adequate in 
a judge’s eyes. How open should the client be in the courtroom? 

The ethics of advocacy research present a number of serious issues that can lead to an ethical 
dilemma: 


e Lawyers’ first responsibility is to represent their clients. Therefore, they might not be inter- 
ested as much in the truth as they are in evidence that supports their client’s position. Present- 
ing accurate research results may harm the client. 

e A researcher should be objective. However, he or she runs the risk of conducting research 
that does not support the desired position. In this case, the lawyer may ask the researcher if 
the results can somehow be interpreted in another manner. 

e Should the lawyer (in this case a user of research) ask the researcher to take the stand and pre- 
sent an inaccurate picture of the results? 


Ethically, the attorney should certainly not put the researcher on the stand and encourage an act of 
perjury. The attorney may hope to ask specific questions that are so limited that taken alone, they 
may appear to support the client. However, this is risky because the opposing attorney likely also 
has an expert witness that can suggest questions for cross-examination. Returning to our branding 
example, if the research does not support an infringement of the known brand’s name, then the 
brand name’s attorney should probably not have the researcher take the stand. 

Advocacy researchers do not necessarily bias results intentionally. However, attorneys rarely 
submit advocacy research evidence that does not support their clients’ positions. 

The question of advocacy research is one of objectivity: Can the researcher seek out the truth 
when the sponsoring client wishes to support its position at a trial? The ethical question stems 
from a conflict between legal ethics and research ethics. Although the courts have set judicial 
standards for research methodology, perhaps only the client and individual researcher can resolve 
this question. 


Privacy 


People believe the collection and distribution of personal information without their knowledge 
is a serious violation of their privacy. The privacy rights of research participants create a privacy 
obligation on the part of the research client. Suppose a database marketing company is offering 
a mailing list compiled by screening millions of households to obtain brand usage information. 
The information would be extremely valuable to your firm, but you suspect those individuals 
who filled out the information forms were misled into thinking they were participating in a sur- 
vey. Would it be ethical to purchase the mailing list? If respondents have been deceived about 
the purpose of a survey and their names subsequently are sold as part of a user mailing list, this 
practice is certainly unethical. The client and the research supplier have the obligation to maintain 
respondents’ privacy. 

Consider another example. Sales managers know that a research survey of their business- 
to-business customers’ buying intentions includes a means to attach a customer’s name to each 
questionnaire. This confidential information could be of benefit to a sales representative calling 
on a specific customer. A client wishing to be ethical must resist the temptation to identify those 
accounts (that is, those respondents) that are the hottest prospects. 
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advocacy research 


Research undertaken to support 
a specific claim in a legal action 
or represent some advocacy 


group. 


A 
a 


z3 
e When a company faces a very emotional decision, it is usually whether you would like to be treated in > 
better to have the research needed to address the related this manner or whether you would like 
research questions done by an outside firm. someone to treat a close member of your 
e The potential for conflict between a client/manager and a family in such a manner. 
researcher can be minimized with better communicationand œ Research that creates some irreversible change 
by making sure that both parties agree on the deliverables of in a participant can rarely be justified. 
a research project before that project is conducted. e Research with particularly vulnerable segments such as 
e Those involved in research should consider the position of children involves special care. When doing research with chil- 
others involved in the process. When considering conducting dren under the age of 16, parental consent is nearly always 
or using research in some manner, one way to help ensure needed. 
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fair treatment of others involved in research is to consider 


Privacy on the Internet 


Privacy on the Internet is a controversial issue. A number of groups question whether Web site 
questionnaires, registration forms, and other means of collecting personal information will be kept 
confidential. Many business researchers argue that their organizations don’t need to know who the 
user is because the individual’s name is not important for their purposes. However, they do want 
to know certain information (such as demographic characteristics or product usage) associated 
with an anonymous profile. For instance, a Web advertiser could reach a targeted audience with- 
out having access to identifying information. Of course, unethical companies may violate ano- 
nymity guidelines. Research shows that consumers are sensitive to confidentiality notices before 
providing information via a Web site. Over 80 percent of consumers report looking for specific 
privacy notices before they will exchange information electronically. In addition, over half believe 
that companies do not do enough to ensure the privacy of personal information. Thus, research 
users should not disclose private information without permission from the consumers who pro- 
vided that information. 


A Final Note on Ethics 


Certainly, there are researchers who would twist results for a client or who would fabricate results 
for personal gain. However, these are not professionals. When one is professional, one realizes 
that one’s actions not only have implications for oneself but also for one’s field. Indeed, just a 
few unscrupulous researchers can give the field a bad name. Thus, researchers should maintain 
the highest integrity in their work to protect our industry. Research participants should also play 
their role, or else the data they provide will not lead to better products for all consumers. Finally, 
the research users must also follow good professional ethics in their treatment of researchers and 
research results. 


Summary 


1. Know when research should be conducted externally and when it should be done inter- 
nally. The company that needs the research is not always the best company to actually perform 
the research. Sometimes it is better to use an outside supplier of some form. An outside agency is 
better when a fresh perspective is needed, when it would be difficult for inside researchers to be 
objective, and when the outside firm has some special expertise. In contrast, it is better to do the 
research in-house when it needs to be done very quickly, when the project requires close collabo- 
ration of many employees within the company, when the budget for the project is limited, and 
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when secrecy is a major concern. The decision to go outside or stay inside for research depends 
on these particular issues. 


2. Be familiar with the types of jobs, job responsibilities, and career paths available within the 
business research industry. The business research function may be organized in any number of 
ways depending on a firm’s size, business, and stage of research sophistication. Business research 
managers must remember they are managers, not just researchers. 

Research offers many career opportunities. Entry-level jobs may involve simple tasks such as 
data entry or performing survey research. A research analyst may be the next step on the career 
path. This position may involve project design, preparation of proposals, data analysis, and inter- 
pretation. Whereas there are several intermediate positions that differ depending on whether one 
works for a small or large firm, the director of research is the chief information officer in charge 
of marketing information systems and other research projects. The director plans, executes, and 
controls the research function for the firm. 


3. Understand the often conflicting relationship between management and researchers. 
Researchers and managers have different and often conflicting goals. Some of the key sources 
of conflict include money, time, intuition, and experience. Managers want to spend the least 
amount of money on research possible, have it done in the shortest period of time conceivable, 
and believe that intuition and experience are good substitutes for research. Researchers will 
exchange greater expense for more precision in the research, would like to take more time to 
be more certain of results, and are hesitant to rely on intuition and experience. Better commu- 
nication is a key to reducing this conflict. One tool that can be useful is the implementation of 
cross-functional teams. 


4. Define ethics and understand how it applies to business research. Business ethics is the appli- 
cation of morals to behavior related to the exchange environment. Generally, good ethics con- 
forms to the notion of “right” and a lack of ethics conforms to the notion of “wrong.” Those 
involved in research face numerous ethical dilemmas. Researchers serve clients or, put another 
way, the doers of research serve the users. It is often easy for a doer to compromise professional 
standards in an effort to please the user. After all, the user pays the bills. Given the large number 
of ethical dilemmas involved in research, ethics is highly applicable to business research. 


5. Know and appreciate the rights and obligations of a) research respondents—particularly 
children, b) business researchers, and c) research clients or sponsors. Each party involved in 
research has certain rights and obligations. These are generally interdependent in the sense that 
one party’s right often leads to an obligation for another party. While the rights and obligations 
of all three parties are important, the obligation of the researcher to protect research partici- 
pants is particularly important. Experimental manipulations can sometimes expose subjects to 
some form of harm or involve them in a ruse. The researcher must be willing to fully inform 
the subjects of the true purpose of the research during a debriefing. The researcher must also 
avoid subjecting participants to undue physical or psychological trauma. In addition, it should 
be reasonably easy to return an experimental subject to his or her original, pre-experiment 
condition. 


6. Know how to avoid a conflict of interest in performing research. A conflict of interest occurs 
when a researcher is faced with doing something to benefit one client at the expense of another 
client. One good way to avoid a conflict of interest is to avoid getting involved with multiple 
projects involving competing firms. 


Key Terms and Concepts 


advocacy research, 101 human subjects review committee, 94 relativism, 89 
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Part 1: Introduction 


Questions for Review and Critical Thinking 


10. 


1l; 


12; 


13: 


14. 


15: 


16. 


What are the conditions that make in-house research prefer- 

able? What are the conditions that make outside research 

preferable? 

Read a recent news article from the Wall Street Journal or other 

key source that deals with a new-product introduction. Would 

you think it would be better for that firm to do research in- 

house or to use an outside agency? Explain. 

What might the organizational structure of the research depart- 

ment be like for the following organizations? 

a. A large advertising agency 

b. A founder-owned company that operates a 20-unit restau- 
rant chain 

c. Your university 

d. An industrial marketer with four product divisions 

e. A large consumer products company 

What problems do research directors face in their roles as 

managers? 

What are some of the basic causes of conflict between manage- 

ment and research? 

Comment on the following situation: A product manager asks 

the research department to forecast costs for some basic ingre- 

dients (raw materials) for a new product. The researcher asserts 

that this is not a research job; it is a production forecast. 

What is the difference between research and pseudo-research? 

Cite several examples of each. 

ETHICS What are business ethics? How are ethics relevant to 

research? 

ETHICS What is the difference between ethical relativism and 

ethical idealism? How might a person with an idealist ethical 

philosophy and a person with a relativist ethical philosophy 

differ with respect to including a sales pitch at the end of a 

research survey? 

ETHICS What obligations does a researcher have with respect to 

confidentiality? 

How should a researcher help top management better under- 

stand the functions and limitations of research? 

ETHICS List at least one research obligation for research partici- 

pants (respondents), researchers, and research clients (sponsors)? 

ETHICS What is a conflict of interest in a research context? How 

can such conflicts of interest be avoided? 

ETHICS What key questions help resolve the question of 

whether or not research participants serving as subjects in an 

experiment are treated ethically? 

Identify a research supplier in your area and determine what 

syndicated services and other functions are available to clients. 

‘NET Use the Internet to find at least five research firms that 

perform survey research. List and describe each firm briefly. 


Research Activities 


Find the mission statement of Burke, Inc. (http://www.burke. 
com). What career opportunities exist at Burke? Would you 
consider it a small, mid-sized, or large firm? 

‘NET—ETHICS One purpose of the United Kingdom’s Market 
Research Society is to set and enforce the ethical standards to 


17; 


18. 


19. 


20. 


What actions might the business research industry take to con- 

vince the public that research is a legitimate activity and that 

firms that misrepresent their intentions and distort findings to 
achieve their aims are not true research companies? 

ETHICS Comment on the ethics of the following situations: 

a. A food warehouse club advertises “savings up to 30 per- 
cent” after a survey showed a range of savings from 2 to 
30 percent below average prices for selected items. 

b. A radio station broadcasts the following message during 
a syndicated rating service’s rating period: “Please fill out 
your diary (which lists what media the consumer has been 
watching or listening to).” 

c. A sewing machine retailer advertises a market test and indi- 
cates that the regular price will be cut to one-half for three 
days only. 

d. A researcher tells a potential respondent that an interview 
will last ten minutes rather than the thirty minutes he or 
she actually anticipates. 

e. A respondent tells an interviewer that she wishes to coop- 
erate with the survey, but her time is valuable and, there- 
fore, she expects to be paid for the interview. 

f. When you visit your favorite sports team’s home page on 
the Web, you are asked to fill out a registration question- 
naire before you enter the site. The team then sells your 
information (team allegiance, age, address, and so on) to a 
company that markets sports memorabilia via catalogs and 
direct mail. 

ETHICS Comment on the following interview: 


Interviewer: Good afternoon, sir. My name is Mrs. Johnson, 
and I am with Counseling Services. We are con- 
ducting a survey concerning Memorial Park. Do 
you own a funeral plot? Please answer yes or no. 

Respondent: (pauses) 

Interviewer: You do not own a funeral plot, do you? 

Respondent: No. 

Interviewer: Would you mind if I sent you a letter concerning 
Memorial Park? Please answer yes or no. 

Respondent: No. 

Interviewer: Would you please give me your address? 


ETHICS Try to participate in a survey at a survey Web site such 
as http://www.mysurvey.com or http://www.themsrgroup.com. Write 
a short essay response about your experience with particular 
attention paid to how the sites have protections in place to 
prevent children from providing personal information. 


be observed by research practitioners. Go to its Web site at 
www.mrs.org.uk. Click on its code of conduct and evaluate it in 
light of the AMA’s code. 
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Case 5.1 Global Eating 
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W Barton Boomer, director of marketing research 


for a large research firm, has a bachelor’s degree 
in marketing from Michigan State University. 
He joined the firm nine years ago after a one- 
year stint as a research trainee at the corporate 
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headquarters of a western packing corporation. 
Barton has a wife and two children. He earns $60,000 a year and 
owns a home in the suburbs. He is typical of a research analyst. He 
is asked to interview an executive with a local restaurant chain, 
Eats-R-Wee. Eats-R-Wee is expanding internationally. The logical 
two choices for expansion are either to expand first to other nations 
that have values similar to those in the market area of Eats-R-Wee 
or to expand to the nearest geographical neighbor. During the initial 
interviews, Mr. Big, Vice President of Operations for Eats-R-Wee, 
makes several points to Barton. 


e “Barton, we are all set to move across the border to Ontario 
and begin our international expansion with our neighbor to the 


north, Canada. Can you provide some research that will support 
this position?” 

e “Barton, we are in a hurry. We can’t sit on our hands for 
weeks waiting to make this decision. We need a comprehensive 
research project completed by the end of the month.” 

e “We are interested in how our competitors will react. Have you 
ever done research for them?” 

e “Don’t worry about the fee; we'll pay you top money for a 
‘good’ report.” 


Marla Madam, Barton’s Director of Research, encourages Barton to 
get back in touch with Mr. Big and tell him that the project will get 
underway right away. 


Question 

Critique this situation with respect to Barton’s job. What recom- 
mendations would you have for him? Should the company get 
involved with the research? Explain your answers. 


Case 5.2 Big Brother Is Watching? 
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E Technology is making our behavior more and 
more difficult to keep secret. Right at this very 


moment, there is probably some way that your 
location can be tracked in a way that researchers 
could use the information. Do you have your 


PHOTODISC GREEN 


| mobile phone with you? Is there an RFID tag in 
your shirt, your backpack, or some other personal item? Are you 
in your car, and does it have a GPS (Global Positioning Satellite) 
device? All of these are ways that your location and movements 
might be tracked. 

For instance, rental cars can be tracked using GPS. Suppose 
a research firm contracts with an insurance firm to study the way 
people drive when using a rental car. A customer’s every movement 
is then tracked. So, if the customer stops at a fast-food restaurant, 
the researcher knows. If the customer goes to the movie when he 
or she should be on a sales call, the researcher knows. If the cus- 
tomer is speeding, the researcher knows. 


Clearly, modern technology is making confidentiality more 
and more difficult to maintain. While legitimate uses of this type of 
technology may assist in easing traffic patterns and providing bet- 
ter locations for service stations, shopping developments, and other 
retailers, at what point does the collection of such information 
become a concern? When would you become concerned about 
having your whereabouts constantly tracked? 


Question 

Suppose a GIS research firm is approached by the state legislature 
and asked to provide data about vehicle movement within the state 
for all cars with a satellite tracking mechanism. Based on the move- 
ment of the cars over a certain time, the police can decide when 

a car was speeding. They intend to use this data to send speeding 
tickets to those who moved too far, too fast. If you are the research 
firm, would you supply the data? Discuss the ethical implications of 
the decision. 


CHAPTER 6 


PROBLEM 
DEFINITION: 
THE FOUNDATION 


1. Explain why proper “problem definition” is essential to 


: OF BUSINESS 


2. Know how to recognize problems R ES E, i RC H 
3. Translate managerial decision statements into relevant 
research objectives 


4. Translate research objectives into research questions 
and/or research hypotheses 


5. Outline the components of a research proposal 
6. Construct tables as part of a research proposal 


Chapter Vignette: Deland Trucking 
Has a “Recruitment” Problem 


David Deland, who has owned his trucking business for 20 years, struggles with the spreadsheet 
in front of him. His recruitment specialist sits glumly across from his desk, pondering what kind of 
response to give to the inevitable question, “Why are our recruitment costs so high?” 
Next to the specialist sits James Garrett, a business research consultant 
who has been hired by the Deland Trucking Company to get a handle 


on the recruitment expenses the company has seen skyrocket over the 
last six months. 


“| just don’t get it,” David sighs in frustration. “We have seen a 45 per- 
cent increase in our trucker recruitment advertising costs, and our trucker 
intake and orientation expenses are killing us! James, | just don’t under- 
stand what is happening here.” 

James and the specialist have had some initial discussions, but there is 
no easy way to reduce those costs without reducing the number of truckers 
that Deland hires. “Perhaps we can find a more efficient way of advertising 
our openings,” suggests the recruiting specialist. “Maybe we can reduce the 
number of orientation sessions or travel expenses associated with the hiring 

process.” David counters, “Well, | don’t see how we are any different from 

our competitors. We use the same recruitment and orientation approach that 
they use. | have no handle on their expenses, but the fact that our expenses 
are skyrocketing must mean something is going on.” 

James stares at his copy of the spreadsheet. “There is no easy way to do 
this, without hurting your ability to keep drivers in your trucks,” he says. “Is 
it that the costs for driver selection and recruitment have gone up?” “No, the 
costs have been the same,” responds the recruiter. “It’s just that we have had to 
do so many orientation and hiring sessions since the first of the year.” 

“David, it might be best if | get a look at some of your hiring statistics, as 
well as your driver census over the last year,” comments James. Turning to the 
recruiter, James asks, “Can you give me some of your driver data to look through?” 

“Sure,” says the recruiter. “We have lots of info about our drivers, and the driver census is 
updated monthly. We even have some exit data we have gathered from a few drivers who have 
left us. | don’t know exactly what the trend is with those drivers who leave, since we haven't had 
a chance to really analyze the data. | will send it to you through e-mail this afternoon.” 

James drives back to his office, reflecting on his meeting. As he passes by trucks on the way, 
he peeks at the drivers who are going in the same direction as he is. What do they think about 
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Part 2: Beginning Stages of the Research Process 


their company? Would they see Deland as a great place to work? What would make Deland Trucking’s 
recruitment costs go so high? 

At his office, the e-mail with the trucker census and the hiring data has already arrived. Opening 
the numerous spreadsheets, James continues to wonder. Does Deland Trucking have a recruitment 
problem? Is the problem the company itself? What is going on? 

As he examines the hiring worksheet, he compares it to the driver census figures for the last six 
months. “There is the problem!” he exclaims. “I think | need to put together a proposal for David on 
this. I’m sure he will be surprised about what his company’s problem really is.” 


decision statement 


A written expression of the key 
question(s) that the research user 
wishes to answer. 


problem definition 


The process of defining and 
developing a decision state- 
ment and the steps involved in 
translating it into more precise 
research terminology, including a 
set of research objectives. 


Introduction 


Importance of Starting with a Good Problem Definition 


The first stage of the research process introduced in the early chapters and highlighted in Chap- 
ter 4 involves translating the business decision situation into specific research objectives. While 
it is tempting to skip this step and go directly to designing a research project, the chances that 
a research project will prove useful are directly related to how well the research objectives cor- 
respond to the true business “problem.” Clearly, the easiest thing for James to do in the opening 
vignette is to start designing a study of Deland Trucking’s recruitment effectiveness. This seems to 
be what David and his specialist want. But is it what they really need? 

This chapter looks at this important step in the research process more closely. Some useful 
tools are described that can help translate the business situation into relevant, actionable research 
objectives. Research too often takes the blame for business failures when the real failure was really 
management’s view of its own company’s situation. The Research Snapshot on page 110 describes 
some classic illustrations involving companies as big and successful as Coca-Cola, R.J. Reynolds, 
and Ford. While the researcher has some say in what is actually studied, remember that the cli- 
ent (either the firm’s management team or an outside sponsor) is the research customer and the 
researcher is serving the client’s needs through research. In other words, when the client fails to 
understand their situation or insists on studying an irrelevant problem, the research is very likely 
to fail, even if it is done perfectly. 

Translating a business situation into something that can be researched is somewhat like trans- 
lating one language into another. It begins by coming to a consensus on a decision statement or 
question. A decision statement is a written expression of the key question(s) that a research user 
wishes to answer. It is the reason that research is being considered. It must be well stated and 
relevant. As discussed in Chapter 4, the researcher translates this into research terms by rephrasing 
the decision statement into one or more research objectives. These are expressed as deliverables in 
the research proposal. The researcher then further expresses these in precise and scientific research 
terminology by creating research hypotheses from the research objectives. 

In this chapter, we use the term problem definition. Realize that sometimes this is really oppor- 
tunity seeking. For simplicity, the term problem definition is adapted here to refer to the process 
of defining and developing a decision statement and the steps involved in translating it into more 
precise research terminology, including a set of research objectives. If this process breaks down at any 
point, the research will almost certainly be useless or even harmful. It will be useless if it presents 
results that simply are deemed irrelevant and do not assist in decision making. It can be harmful both 
because of the wasted resources and because it may misdirect the company in a poor direction. 

Ultimately, it is difficult to say that any one step in the research process is most important. 
However, formally defining the problem to be attacked by developing decision statements and 
translating them into actionable research objectives must be done well or the rest of the research 
process is misdirected. Even a good road map is useless unless you know just where you are going. 
All of the roads can be correctly drawn, but they still don’t get you where you want to be. Simi- 
larly, even the best research procedures will not overcome poor problem definition. 
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Wi j Consider the following questions as 
$ you think about this section of the 
survey and other sections of the survey 
A 


not shown here. 


What kinds of decision statements might be involved 
using the information collected in this portion of the 
survey? Think about the types of companies that might 
be interested in this information. 

Would any nonprofit institutions be interested in this 
data? 

Translate a decision statement from above into a 
research question and the related research hypothesis 
or hypotheses. 

What would a dummy table look like that might provide 
the data for these hypotheses? 
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Problem Complexity 


Ultimately, the quality of business research in improving business decisions is limited by the quality of the 
problem definition stage. This is far from the easiest stage of the research process. Indeed, it can be the 
most complex. Exhibit 6.1 helps to illustrate factors that influence how complex the process can be. 


EXHIBIT 6.1 
rere Research Defining Problems Can Be 
Situation Objectives Difficult 


Easier: 
1. Situation is recurring/routine 
2. A dramatic change occurs 
3. Symptoms are isolated 
4. Symptoms are consistent 


Harder: 
1. Situation appears new 
2. Change(s) in situation is 
subtle 
3. Symptoms are scattered 
4. Symptoms are ambiguous 
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Good Answers, Bad Questions? 
It's amazing, but sometimes even the most successful companies 
make huge blunders. These blunders often are based on a mis- 
understanding of exactly what the brand and/or product means 
to consumers. Some of the famous, or infamous, examples of 
such blunders include RJR’s introduction of Premier “Smokeless” 
Cigarettes, Ford’s introduction of the Edsel in the 1950s, and 
most famous (or infamous) of all, Coca-Cola’s introduction of 
New Coke as a replacement for regular “old” Coke. 

Volumes have been written about each of these episodes. 
One does have to wonder, how did these great companies do 
such apparently dumb things? The blame is often placed at the 
foot of the decision makers: “Research should have revealed that 
product was a loser.” However, researchers address the ques- 
tions they are asked to address by management. Certainly, the 
researchers play a role in framing any decision situation into 
something that can be addressed by a pointed research question. 
The decision makers almost always start the process by asking 
for input from their staff, or from research consultants they have 
hired. Hopefully, the dialogue that results will lead to a productive 
research question that will provide useful results. However it isn’t 
always the case that such research questions are self-evident. 

Hindsight certainly is clearer than foresight. It seems almost 
unthinkable that Coke could have made its decision to replace a 
product with a century-long success record without considering 
the emotional meaning that goes along with drinking a “Coke.” 
However, management considered Coke to be a beverage, not a 
brand. Thus, the focus was on the taste of Coke. Thus, researchers 
set about trying to decide if New Coke, which was more similar 
to Pepsi, tasted better than the original Coke. A great deal of very 
careful research suggested clearly that it did taste better. If the 
key question was taste, New Coke was preferred over old Coke 
by more consumers. In fact, there was considerable evidence 
that already showed a taste preference for Pepsi over old Coke. 
Interestingly, Coke appeared to view itself as its primary competi- 
tor. At least two very important questions were never asked or 
were addressed insufficiently: 


1. Do consumers prefer New 
Coke over Pepsi? 


Good research does not 
guarantee correct decisions. 


2. When people know what they are drinking, 
do they still prefer New Coke to old Coke? 


For a taste test to be valid, it is should be 
done “blindly,” meaning that the taster 
doesn’t know what he or she is drinking. Only 
then can one assess taste without being psycho- 

logically influenced by knowing the brand. So, Coke and Pepsi 
conducted a blind taste test. This is certainly a good research 
practice—if the question is taste. The Coke research correctly 
answered the taste question. The big problem is that since 
management didn’t realize that most of the meaning of Coke is 
psychological, and since they were so convinced that their old 
product was “inferior,” the dialogue between management and 
researchers never produced more useful questions. 

In the case of Ford’s Edsel, a postmortem analysis suggests 
that research actually indicated many of the problems that ulti- 
mately led to its demise. The name, Edsel, was never tested by 
research, even though hundreds of other possibilities were. 

Similarly, the idea of a smokeless cigarette seemed appealing. 
Research addressed the question, “What is the attitude of smok- 
ers and nonsmokers toward a smokeless cigarette?” Nonsmokers 
loved the idea. Smokers, particularly those who lived with a 
nonsmoker, also indicated a favorable attitude. However, as we 
know, the product failed miserably. If you take the “smoke” out of 
“smoking,” is it still the same thing? This question was never asked. 
Would someone who would try a smokeless cigarette replace their 
old brand with this new brand? Again, this wasn’t asked. 

Today, it is possible that some famous company could be 
making a very similar mistake. Consider Macy's. Macy's has 
acquired many regional and local department stores around the 
country over the past few years. Clearly, Macy’s is a very recog- 
nizable name brand that brings with it considerable “equity.” 
How important is it for Macy's to ask, “What is the best name for 
this department store?” If the acquisition involves taking over a 
local retail “institution,” is a name change always a good thing? 
Certainly, it seems to be a good question to which research could 
probably provide a good answer! 


Sources: Gibson, Larry, “Why the New Coke Failed,” Marketing Research 15 (Summer 
2003), 52; “Is Macy's the New Coke?” Advertising Age 76 (September 26, 2005), 24. 


SITUATION FREQUENCY 


Many business situations are cyclical. Cyclical business situations lead to recurring business prob- 


lems. These problems can even become routine. In these cases, it is easy to define problems and 


identify the types of research that are needed. In some cases, problems are so routine that they can 


be solved without any additional research. Recurring problems can even be automated through 


a company’s DSS. 


For example, pricing problems often occur routinely. Just think about how the price of gas 


fluctuates when several stations are located within sight of each other. One station’s prices defi- 


nitely affect the sales of the other stations as well as of the station itself. Similarly, automobile 


companies, airline companies, and computer companies, to name just a few, face recurrin 


pricing issues. Because these situations recur so frequently, addressing them becomes routine. 


Decision makers know how to communicate them to researchers and researchers know what data 


are needed. 
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Most pricing decisions in the airline industry are automated based on sophisticated demand 
models. The models take into account fluctuations in travel patterns based on the time of the year, 
time of the day, degree of competition for that particular route, and many other factors. At one 
time, these decisions were based on periodic research reports. Now, the information is simply fed 
into a decision support system that generates a pricing schedule. It is interesting that one factor 
that is not very important in many of these pricing decisions is the cost involved in flying some- 
one from point A to point B. Indeed, some passengers pay a fare much higher than the actual 
costs and others pay a fare much lower than the actual costs involved in getting them to their 
desired destination. 


DRAMATIC CHANGES 


When a sudden change in the business situation takes place, it can be easier to define the prob- 
lem. For example, if Deland’s business had increased sharply at the beginning of the year, the 
key factors to study could be isolated by identifying other factors that have changed in that same 
time period. It could be that a very large trucking contract had been obtained, or that a current 
customer dramatically increased their distribution needs, which Deland is benefiting from. 

In contrast, when changes are very subtle and take effect over a long period of time, it can be 
more difficult to define the actual decision and research problems. Detecting trends that would 
permanently affect the recruitment challenges that Deland faces can be difficult. It may be difficult 
to detect the beginning of such a trend and even more difficult to know whether such a trend is 
relatively permanent or simply a temporary occurrence. 


HOW WIDESPREAD ARE THE SYMPTOMS? 


The more scattered any symptoms are, the more difficult it is to put them together into some 
coherent problem statement. In contrast, firms may sometimes face situations in which mul- 
tiple symptoms exist, but they are all pointing to some specific business area. For instance, an 
automobile manufacturing company may exhibit symptoms such as increased complaints about 
a car’s handling, increased warranty costs due to repairs, higher labor costs due to inefficiency, 
and lower performance ratings by consumer advocates such as Consumer Reports. All of these 
symptoms point to production as a likely problem area. This may lead to research questions 
that deal with supplier-manufacturer relationships, job performance, job satisfaction, supervisory 
support, and performance. Although having a lot of problems in one area may not sound very 
positive, it can be very helpful in pointing out the direction that is most in need of attention 
and improvement. 

In contrast, when the problems are more widespread, it can be very difficult to develop use- 
ful research questions. If consumer complaints dealt with the handling and the appearance of the 
car, and these were accompanied by symptoms including consumer beliefs that gas mileage could 
be better and that dealerships did not have a pleasant environment, it may be more difficult to 
put these scattered symptoms together into one or a few related research questions. Later in the 
chapter, we'll discuss some tools for trying to analyze symptoms in an effort to find some potential 
common cause. 


SYMPTOM AMBIGUITY 


Ambiguity is almost always unpleasant. People simply are uncomfortable with the uncertainty that 
comes with ambiguity. Similarly, an environmental scan of a business situation may lead to many 
symptoms, none of which seem to point in a clear and logical direction. In this case, the problem 
area remains vague and the alternative directions are difficult to ascertain. 

A retail store may face a situation in which sales and traffic are up, but margins are down. 
They may have decreased employee turnover, but lower job satisfaction. In addition, there may 
be several issues that arise with their suppliers, none of which is clearly positive or negative. In this 
case, it may be very difficult to sort through the evidence and reach a definitive decision statement 
or list of research objectives. 
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problem 


Occurs when there is a difference 
between the current conditions 
and a more preferable set of 
conditions. 


situation analysis 


The gathering of background 
information to familiarize 
researchers and managers with 
the decision-making environment. 


Part 2: Beginning Stages of the Research Process 


The Problem-Definition Process 


Problems Mean Gaps 


A problem occurs when there is a difference between the current conditions and a more prefer- 


able set of conditions. In other words, a gap exists between the way things are now and a way that 


things could be better. The gap can come about in a number of ways:! 


‘he 


Business performance is worse than expected business performance. For instance, sales, profits, 
and margins could be below targets set by management. This is a very typical type of problem 
analysis. Think of all the new products that fail to meet their targeted goals. Trend analysis 
would also be included in this type of problem. Management is constantly monitoring key 
performance variables. Previous performance usually provides a benchmark forming expecta- 
tions. Sales, for example, are generally expected to increase a certain percentage each year. 
When sales fall below this expectation, or particularly when they fall below the previous year’s 
sales, management usually recognizes that they have a potential problem on their hands. The 
Research Snapshot on the next page illustrates this point. 

Actual business performance is less than possible business performance. Realization of this gap 
first requires that management have some idea of what is possible. This may form a research 
problem in and of itself. Opportunity-seeking often falls into this type of problem-definition 
process. Many American and European Union companies have redefined what possible sales 
levels are based upon the expansion of free markets around the world. China’s Civil Aviation 
Administration has relaxed requirements opening the Chinese air travel market to private 
airlines.* Suddenly, the possible market size for air travel has increased significantly, creating 
opportunities for growth. 

Expected business performance is greater than possible business performance. Sometimes, 
management has unrealistic views of possible performance levels—either too high or too low. 
One key problem with new product introductions involves identifying realistic possibilities 
for sales. While you may have heard the old adage that 90 percent of all new products fail, 
how many of the failures had a realistic sales ceiling? In other words, did the company know 
the possible size of the market? In this case, the problem is not with the product but with the 
plan. Some product “failures” may actually have been successful if management had a more 
accurate idea of the total market potential. Management can close this gap through decision 
making. Researchers help managers make decisions by providing relevant input. 


The Problem-Definition Process Steps 


The problem-definition process involves several interrelated steps, as shown in Exhibit 6.2. Some- 
times, the boundaries between each step aren’t exactly clear. But generally, completing one step 
leads to the other and by the time the problem is defined, each of these steps has been addressed 
in some way. The steps are 


1 
2 
3. 
4. 
5 
6 
A 


Understand the business situation—identify key symptoms 

Identify key problem(s) from symptoms 

Write managerial decision statement and corresponding research objectives 
Determine the unit of analysis 

Determine the relevant variables 

Write research questions and/or research hypotheses 


separate section deals with each stage below. 


Understand the Business Decision 


A situation analysis involves the gathering of background information to familiarize researchers 


and managers with the decision-making environment. The situation analysis can be written up 
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A Why Did Our Employees 
~ Leave? FleetBoston’s Initiatives 
to Stop the Exit 

Getting bigger does not always translate easily to 
better performance. FleetBoston, prior to its own 
acquisition by Bank of America, had grown to one of the largest 
banks in the United States through a series of mergers and acqui- 
sitions. With each acquisition, however, came the usual “growing 
pains” that can create dissatisfaction among existing and new 
employees. With employee turnover rates approaching 40 per- 
cent, FleetBoston compared itself to industry averages and found 
itself underperforming. In fact, the customer-focused mission of 
FleetBoston was genuinely believed to be at risk. 

What could they do? Through a series of careful studies the 
research team realized that employees are likely to stay when 
they feel that opportunities are there for them, and that the bank 
provided a more stable management within which they could 


grow. Additionally, these studies revealed that the quality of 
the hiring process directly impacted the length of stay for those 
same employees. 

As a result, FleetBoston was able to create a set of retention 
strategies that focused on what the bank employees do and what 
they value in their work environment. These strategies yielded 
short-term benefits that directly affected their bottom line. By 
hiring better, and by creating opportunities for those employees 
to stay, turnover rates were reduced significantly. This in turn led 
to a reduced need to spend money on recruitment costs. All in 
all, the benefits of carefully examining performance as measured 
through employee retention paid off. FleetBoston had success- 


fully stopped the exit. 


Source: Nalbantian, H. R. and A. Szostak, 
“How Fleet Bank Fought Employee 
Flight”, Harvard Business Review 

(April 2004), 116-125. 


The Problem-Definition 
Process 


as a way of documenting the problem-definition process. Gaining an awareness of marketplace 


conditions and an appreciation of the situation often requires exploratory research. Researchers 


sometimes apply qualitative research with the objective of better problem definition. The situation 


analysis begins with an interview between the researcher and management. 


INTERVIEW PROCESS 


The researcher must enter a dialogue with the key decision makers in an effort to fully under- 


stand the situation that has motivated a research effort. This process is critical and the researcher 


should be granted access to all individuals who have specific knowledge of or insight into this 


situation. Researchers working with managers who want the information “yesterday” often get 
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interrogative techniques 


Asking multiple what, where, who, 
when, why, and how questions. 


probing 


An interview technique that 
tries to draw deeper and more 
elaborate explanations from the 
discussion. 


Part 2: Beginning Stages of the Research Process 


little assistance when they ask, “What are your objectives for this study?” Nevertheless, even 
decision makers who have only a gut feeling that the research might be a good idea benefit 
greatly if they work with the researcher to articulate precise research objectives.* Even when 
there is good cooperation, seldom can key decision makers express the situation in research 
terms: 


Despite a popular misconception to the contrary, objectives are seldom clearly articulated and given to the 
researcher. The decision maker seldom formulates his objectives accurately. He is likely to state his objec- 
tives in the form of platitudes which have no operational significance. Consequently, objectives usually 
have to be extracted by the researcher. In so doing, the researcher may well be performing his most useful 
service to the decision maker.* 


Researchers may often be tempted to accept the first plausible problem statement offered by 
management. For instance, in the opening vignette, it is clear that David believes there is a recruit- 
ment problem. However, it is very important that the researcher not blindly accept a convenient 
problem definition for expediency’s sake. In fact, research demonstrates that people who are better 
problem solvers generally reject problem definitions as given to them. Rather, they take informa- 
tion provided by others and re-associate it with other information in a creative way. This allows 
them to develop more innovative and more effective decision statements.” 

There are many ways to discover problems and spot opportunities. There is certainly much 
art involved in translating scattered pieces of evidence about some business situation into relevant 
problem statements and then relevant research objectives. While there are other sources that 
address creative thinking in detail, some helpful hints that can be useful in the interview process 
include 


1. Develop many alternative problem statements. These can emerge from the interview material 
or from simply rephrasing decision statements and problem statements. 

2. Think about potential solutions to the problem.° Ultimately, for the research to be actionable, 
some plausible solution must exist. After pairing decision statements with research objectives, 
think about the solutions that might result. This can help make sure any research that results 
is useful. 

3. Make lists. Use free-association techniques to generate lists of ideas. The more ideas, the bet- 
ter. Use interrogative techniques to generate lists of potential questions that can be used in the 
interview process. Interrogative techniques simply involve asking multiple what, where, who, 
when, why, and how questions. They can also be used to provoke introspection, which can 
assist with problem definition. 

4. Be open-minded. It is very important to consider all ideas as plausible in the beginning stages 
of problem solving. One sure way to stifle progress is to think only like those intimately 
involved in the business situation or only like those in other industries. Analogies can be useful 
in thinking more creatively. 


IDENTIFYING SYMPTOMS 


Interviews with key decision makers also can be one of the best ways to identify key problem 
symptoms. Recall that all problems have symptoms just as human disease is diagnosed through 
symptoms. Once symptoms are identified, then the researcher must probe to identify possible 
causes of these changes. Probing is an interview technique that tries to draw deeper and more 
elaborate explanations from the discussion. This discussion may involve potential problem causes. 
This probing process will likely be very helpful in identifying key variables that are prime candi- 
dates for study. 

One of the most important questions the researcher can ask during these interviews is, “what 
has changed?” Then, the researcher should probe to identify potential causes of the change. At the 
risk of seeming repetitive, it is important that the researcher repeat this process to make sure that 
some important change has not been left out. 

In addition, the researcher should look for changes in company documents, including financial 
statements and operating reports. Changes may also be identified by tracking down news about 
competitors and customers. Exhibit 6.3 provides a summary of this approach. 
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Question: What changes have 
occurred recently? 


Probe: Tell me about this change. 
Probe: What has brought this about? 


Problem: How might this be 
related to your problem? 


Question: What other changes 
have occurred recently (i.e., 
competitors, customers, 
environment, pricing, promotion, 
suppliers, employees, etc.)? 


Continue Probing 


Think back to the opening vignette. Often, multiple interviews are necessary to identify all 
the key symptoms and gain a better understanding of the actual business situation. On a follow-up 
interview, the dialogue between James and David may proceed as follows: 


James: David, it is clear that your recruitment costs have been increasing since the start of the 
year. What other changes have occurred inside of your business within the past year? 

David: Just a few things. We have had pressures on our bottom line, so we held back on raising 
the cents per mile that we give our drivers. Also, we have had to extend our long-haul 
trucking needs, so our drivers are on the road for a much longer period of time for each 
trip. 

James (probing): Tell me, what led to this decision to extend the driver’s time on the road? 

David: It just worked out that way. Our contract just changed to allow us to do this, and our 
operations manager felt we could make more money per load this way. 

James: Have you noticed changes in your customers? 

David: We do see that they are a little irritated due to some of the problems of getting their freight 
delivered successfully. 

James: Has there been a change in personnel? 

David: Yes, we’ve had more than the usual share of turnover. I’ve turned over most personnel 
decisions to our new human resources manager. We’ve had trouble maintaining a person 
in that role. 


In the change interview, the researcher is trying to identify possible changes in the customers, 
the competitors, the internal conditions of the company, and the external environment. The inter- 
play between things that have changed and things that have stayed the same can often lead to key 
research factors. Before preparing the proposal, James and David agree that the real decision faced 
is not as narrow as a recruiting problem. In this case, James is beginning to suspect that one key 
factor is that the increase in recruitment costs is a reflection of increased driver turnover. If driver 
retention could be increased, the need for larger recruitment expenses would stabilize, or even go 
down. 

Almost any situation can be framed from a number of different perspectives. A pricing prob- 
lem may be rephrased as a brand image problem. People expect high quality products to have 
higher prices. A quality problem may be rephrased as a packaging problem. For example, a potato 
chip company thought that a quality differential between their potatoes and their competitor’s was 
the cause for the symptom showing sliding market share. However, one of the research questions 
that eventually resulted dealt with consumer preferences for packaging. In the end, research sug- 
gested that consumers prefer a foil package because it helps the chips stay fresher longer. Thus, the 
key gap turned out to be a package gap!’ 


EXHIBIT 6.3 
What Has Changed? 
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Opportunity Is a “Fleeting” Thing 

Have non-European automotive companies missed out on 
European opportunities? Europe represents a nearly $17 million 
annual market for new automobiles. Traditionally, the thinking is 
that European’s prefer smaller or “light-cars.” Thus, European car 
companies like BMW and Audi were slow to enter the SUV mar- 
ket. Mercedes entered the SUV market rather early on, but the 
emphasis was on the American market. American and Japanese 
companies offered little more than a token effort at selling SUVs 
in Europe. Thus, the SUV wars were fought in America where 
total volume reached 4 million shortly after 2000. Europeans 
were left with fewer choices if an SUV struck their fancy. 

As a result, pre-2000 SUV sales in Europe were almost nonex- 
istent. However, SUV sales in Europe have increased dramatically 
since then. By 2004, European SUV sales reached 16.5 million 
units, about one in twenty of all new autos sold in Europe. Today, 
Nissan, Toyota, Land Rover, and Suzuki are major players in the 
European SUV market. However, sales expectations for new 
entries from Opel, Renault, 
Volkswagen, Mercedes, and 
Audi are sluggish through 
2008 with so many SUVs to 
choose from coupled with 


Researchers should make sure that they have uncovered all possible relevant symptoms and 
considered their potential causes. Perhaps more interview time with key decision makers asking 
why people choose Coke would have helped identify some of the less tangible aspects of the 
Coke-Pepsi-New Coke battle. Similarly, as seen in the Research Snapshot above, the makers of 
automobiles in the United States should examine more carefully the possible ways that consumers 


high fuel prices. In hindsight, could it be that Ey 
several prominent automobile companies J I 
missed opportunities in Europe because f 
they failed to know how big the market 

truly was? 

Looking at this from the opposite direction, 
the tiny (by U.S. standards) two-seater SMART (http://www.smartusa. 
com) car has being introduced in the United States. Approximately 
30,000 U.S. consumers have put down $99 to reserve the right to 
buy a SMART car since its introduction. SMART is poised to take 
advantage of an opportunity created by high gas prices while GM 
scrambles to turn production away from large SUVs like HUMMER 
toward new entries like the Chevrolet Volt. The relative success 
of these new entries against European minis like the SMART 
may also depend on the exchange rate which presently makes 
European entries expensive in the United States. Word is there 
may even be a SMART SUV—a miniature version of an American 
icon. What is the SMART future? 


Sources: “The Business Week,” Business Week 4008 (June 16, 2008), 6-10; Crain, K.C., 
“Analyst Sees Sales Decline for Light Vehicles in 2005,” Automotive News 79 (January 
24, 2005), 111; Meiners, Jena, “SUV Sales in Europe Will Peak in 2008,” Automotive 
News Europe 9 (June 28, 2004); Marquand, R., “Euorpe’s Little Smart Car to Hit U.S. 
Streets,” Christian Science Monitor (2008), http://www.csmonitor.com/2008/0109/ 
p01s01-woeu.html, accessed July 31, 2008. 


make choices about the vehicles they buy. It can help avoid mistakes later. 


Identifying the Relevant Issues from the Symptoms 


into a working problem definition by focusing on symptoms. The probing process discussed on 
pages 115-116 begins this process. However, the researcher needs to be doubly certain that the 


Anticipating the many influences and dimensions of a problem is impossible for any researcher 
or executive. The preceding interview is extremely useful in translating the decision situation 


research attacks real problems and not superficial symptoms. 


For instance, when a firm has a problem with advertising effectiveness, the possible causes 
of this problem may be low brand awareness, the wrong brand image, use of the wrong media, 
or perhaps too small a budget. Certain occurrences that appear to be the problem may be only 


—DMarcel Proust 


symptoms of a deeper problem. Exhibit 6.4 illustrates how symptoms can be translated into a 


problem and then a decision statement. 


Writing Managerial Decision Statements 
and Corresponding Research Objectives 


The situation analysis ends once researchers have a clear idea of the managerial objectives from 
the research effort. Decision statements capture these objectives in a way that invites multiple 
solutions. Multiple solutions are encouraged by using plural nouns to describe solutions. In other 
words, a decision statement that says in what “ways” a problem can be solved is better than one 
that says in what “way” a problem can be solved. Ultimately, research may provide evidence 


showing results of several ways a problem can be attacked. 
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Symptoms Can Be Confusing 


Firm’s Probable 
Symptoms Problem 


Situation 
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Decision 
Statement 


Consider results of 
probing and apply 
creative processes 


Research Action Conduct Situation Analysis including interviews 


with key decision makers 


Express in actionable 
terms and make sure 
decision makers are in 
agreement 


Situation 1 22-year-old + Declining Swim facility is 
neighborhood Membership for outdated and does 
swimming association 6 years not appeal to younger 
seeks research help + Increased attendance families. Younger 

at new water park families and children 
+ Less frequent usage have a negative 
among members image of pool. Their 
“old market” is aging. 

Situation 2 Manufacturer of + Distributors + Business users do 
palm-sized computer complain prices are not see advantages 
with wireless Internet too high of smaller units 
access believes e Business users - Advantages are 
B2B sales are too low still use larger not outweighed by 

computers costs 
+ Transition costs 
may be a drawback 
for B2B customers 
more than for B2C 
customers 

Situation 3 A new microbrewery + Consumers seem Is there a negative 
is trying to establish to prefer national flavor gap? 
itself brands over the 

local microbrew Do consumers 
products appreciate the micro- 


Many customers 
order national 
brands within the 
microbrew itself 
Some customers 
hesitant to try new 
microbrew flavors 


brew approach and 
the full beer tasting 
(as opposed to 
drinking) experience? 


Decision statements must be translated into research objectives. At this point, the researcher 
is starting to visualize what will need to be measured and what type of study will be needed. 
Exhibit 6.5 on the next page extends the examples from Exhibit 6.4, showing research objectives 
that correspond to each decision statement. Note that each research objective states a correspond- 
ing potential result(s) of the research project. Thus, in some ways, it is stating the information that 
is needed to help make the decision. Once the decision statement is written, the research essen- 
tially answers the question, “What information is needed to address this situation?” 

Referring back to the opening vignette, the analysis of the symptoms has led to the conclusion 
that there is an employee retention problem. Perhaps drivers are dissatisfied with being away from 
their families for so long and this is leading to higher levels of driver turnover. Or, perhaps it is the 
cents per mile that is leading to driver frustration and a desire to go to a higher-paying competitor. 
David and James eventually agree on the following decision statement: 


In what ways can Deland Trucking build driver loyalty so that retention increases and subsequent recruit- 
ment costs decrease? 


What information or data will be needed to help answer this question? Obviously, we’ll need 
to study the driver census and the number of hires needed to fill open positions. James needs to 
find out what might cause employee dissatisfaction and cause turnover to increase. Thinking back 
to the interview, James knows that there have been several changes in the company itself, many 
related to saving costs. Saving costs sounds like a good idea; however, if it harms driver loyalty 


What things can be 
done to energize new 
markets and create a 
more favorable attitude 
toward the association? 


What things can be 
done to improve 
competitive positioning 
of the new product in 
B2B markets? 


How can we encourage 
more consumers to 
come to the microbrew 
and try our products? 


Should we redesign the 
brewery to be more 
inviting? 
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Decision 


Statement 


Research 
Objectives 
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Research 
Questions 


Research 
Hypotheses 


Research Action 


Express in actionable 
terms and make sure 
decision makers are in 
agreement 


Expresses potential 
research results that 
should aid decision- 
making 


Ask a question that 
corresponds to each 
research objective 


Specific statement 
explaining 
relationships, usually 
involving two variables, 
and including the 
direction of the 
relationship 


Situation 1 


Situation 2 


Situation 3 


What things can be 
done to energize new 
markets and create a 
more favorable attitude 
toward the association? 


What product features 
can be improved 

and emphasized to 
improve competitive 
positioning of the 
new product in B2B 
markets? 


How can we encourage 
more consumers to 
come to the microbrew 
and try our products? 


Should we redesign the 
brewery to be more 
inviting? 


Determine reasons 
why families may 
choose to join or not 
join a “swim club.” 


List actions that 

may overcome the 
objections (switching 
costs) of B2B 
customers toward 
adoption of the new 
product. 


Describe how 
situational factors 
influence beer 
consumption and 
consumer attitudes 


toward beer products. 


List factors that 

will improve 
attitudes toward the 
microbrewery. 


How do the type of 
facilities and pricing 
relate to family 
attitudes toward a 
swim facility? 


What are the factors 
that most lead to 
perceptions of high 
switching costs? 


Do situational factors 
(such as time of 

day, food pairings, 

or environmental 
factors) relate to taste 
perceptions of beer? 


Child-friendly pool 
designs are positively 
related to attitudes 
toward the facility. 


Flexible pricing policies 
are positively related 
to attitudes toward the 
facility. 


Perceived difficulty in 
learning how to use the 
new device is related to 
switching costs. 


Price is positively related 
to switching costs. 


Knowledge of new 
product is positively 
related to switching costs. 


Microbrew beer 
is preferred when 
consumed with food. 


An exciting atmosphere 
will improve consumer 
attitudes toward the 
microbrew. 


even slightly, it probably isn’t worthwhile. Thus, the corresponding research objectives are stated 


as follows: 


e Determine what key variables relate to driver loyalty within the company, meaning (1) how 


does the lower level of pay impact driver retention and (2) what does the increase in long-haul 


trucking do to Deland Trucking’s ability to increase retention? 


e Assess the impact of different intervention strategies on driver satisfaction 


These research objectives are the deliverables of the research project. A research study will 


be conducted that (1) shows how much each of several key variables relates to loyalty and reten- 


tion and (2) provides a description of likelihood of different intervention strategies on driver 


satisfaction. 


The researcher should reach a consensus agreement with the decision maker regarding the 


overall decision statement(s) and research objectives. If the decision maker agrees that the state- 


ment captures the situation well and understands how the research objectives, if accomplished, 


will help address the situation, then the researcher can proceed. The researcher should make every 


effort to ensure that the decision maker understands what a research project can deliver. If there is 


no agreement on the decision statement or research objectives, more dialogue between decision 


makers and researchers is needed. 
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Determine the Unit of Analysis 


The unit of analysis for a study indicates what or who should provide the data and at what level of 
aggregation. Researchers specify whether an investigation will collect data about individuals (such 
as customers, employees, and owners), households (families, extended families, and so forth), orga- 
nizations (businesses and business units), departments (sales, finance, and so forth), geographical 
areas, or objects (products, advertisements, and so forth). In studies of home buying, for example, 
the husband/wife dyad typically is the unit of analysis rather than the individual because many 
purchase decisions are made jointly by husband and wife. 

Researchers who think carefully and creatively about situations often discover that a problem 
can be investigated at more than one level of analysis. For example, a lack of worker productivity 
could be due to problems that face individual employees or it could reflect problems that are pres- 
ent in entire business units. Determining the unit of analysis should not be overlooked during the 
problem definition stage of the research. 


Determine Relevant Variables 


WHAT IS A VARIABLE? 


What things should be studied to address a decision statement? Researchers answer this question 
by identifying key variables. A variable is anything that varies or changes from one instance to 
another. Variables can exhibit differences in value, usually in magnitude or strength, or in direc- 
tion. In research, a variable is either observed or manipulated, in which case it is an experimental 
variable. 

The converse of a variable is a constant. A constant is something that does not change. Con- 
stants are not useful in addressing research questions. Since constants don’t change, management 
isn’t very interested in hearing the key to the problem is something that won’t or can’t be changed. 
In causal research, it can be important to make sure that some potential variable is actually held 
constant while studying the cause and effect between two other variables. In this way, a spurious 
relationship can be ruled out. At this point however, the notion of a constant is more important 
in helping to understand how it differs from a variable. 


TYPES OF VARIABLES 


There are several key terms that help describe types of variables. The variance in variables is captured 
either with numerical differences or by an identified category membership. In addition, different 
terms describe whether a variable is a potential cause or an effect. 

A continuous variable is one that can take on a range of values that correspond to some quan- 
titative amount. Consumer attitude toward different airlines is a variable that would generally be 
captured by numbers, with higher numbers indicating a more positive attitude than lower num- 
bers. Each attribute of airlines’ services, such as safety, seat comfort, and baggage handling can be 
numerically scored in this way. Sales volume, profits, and margin are common business metrics 
that represent continuous variables. 

A categorical variable is one that indicates membership in some group. The term classificatory 
variable is sometimes also used and is generally interchangeable with categorical variable. Categorical 
variables sometimes represent quantities that take on only a small number of values (one, two, or 
three). However, categorical variables more often simply identify membership. 

For example, people can be categorized as either male or female. A variable representing 
biological sex describes this important difference. The variable values can be an “M” for member- 
ship in the male category and an “F” for membership in the female category. Alternatively, the 
researcher could assign a “0” for men and a “1” for women. In either case, the same information 
is represented. 

A common categorical variable in consumer research is adoption, meaning the consumer 
either did or did not purchase a new product. Thus, the two groups, purchase or not purchase, 
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unit of analysis 


A study indicates what or who 
should provide the data and at 
what level of aggregation. 


variable 


Anything that varies or changes 
from one instance to another; 
can exhibit differences in value, 
usually in magnitude or strength, 
or in direction. 


constant 


Something that does not change; 
is not useful in addressing 
research questions. 


continuous variable 


A variable that can take on a 
range of values that correspond 
to some quantitative amount. 


categorical variable 


A variable that indicates mem- 
bership in some group. 


classificatory variable 


Another term for a categorical 
variable because it classifies units 
into categories. 
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Several variables describe child 
consumers. Their biological sex 
is a categorical variable; how 
much they weigh, or how often 
they go out to the mall are 
continuous variables. 


dependent variable 


A process outcome or a vari- 
able that is predicted and/or 
explained by other variables. 


independent variable 


A variable that is expected to 
influence the dependent variable 
in some way. 


Part 2: Beginning Stages of the Research Process 


comprise the variable. Similarly, turnover, 
or whether an employee has quit or not, is a 
common organizational variable. 

In descriptive and causal research, the 
terms dependent variable and independent vari- 
able describe different variable types. This 
distinction becomes very important in under- 
standing how business processes can be mod- 
eled by a researcher. The distinction must be 
clear before one can correctly apply certain 
statistical procedures like multiple regres- 
sion analysis. In some cases, however, such 
as when only one variable is involved in a 
hypothesis, the researcher need not make this 
distinction. 

A dependent variable is a process out- 
come or a variable that is predicted and/or 
explained by other variables. An independent 
variable is a variable that is expected to influ- 
ence the dependent variable in some way. Such variables are independent in the sense that they 
are determined outside of the process being studied. That is another way of saying that dependent 
variables do not change independent variables. 

For example, average customer loyalty may be a dependent variable that is influenced or pre- 
dicted by an independent variable such as perceptions of restaurant food quality, service quality, 
and customer satisfaction. Thus, a process is described by which several variables together help 
create and explain how much customer loyalty exists. In other words, if we know how a customer 
rates the food quality, service quality, and satisfaction with a restaurant, then we can predict that 
customer’s loyalty toward that restaurant. Note that this does not mean that we can predict food 
quality or service quality with customer loyalty. 

Dependent variables are conventionally represented by the letter Y. Independent variables 
are conventionally represented by the letter X. If research involves two dependent variables and 
two or more independent variables, subscripts may also be used to indicate Y,, Y, and X,, X,, 
and so on. 

Ultimately, theory is critical in building processes that include both independent and depen- 
dent variables (see Chapter 4). Managers and researchers must be careful to identify relevant and 
actionable variables. Relevant means that a change in the variable matters and actionable means that 
a variable can be controlled by managerial action. Superfluous variables are those that are neither 
relevant nor actionable and should not be included in a study. Theory should help distinguish 
relevant from superfluous variables. 

The process of identifying the relevant variables overlaps with the process of determining the 
research objectives. Typically, each research objective will mention a variable or variables to be 
measured or analyzed. As the translation process proceeds through research objectives, research 
questions, and research hypotheses, it is usually possible to emphasize the variables that should be 
included in a study (as in Exhibits 6.5 and 6.6). 

Exhibit 6.6 includes some common business research hypotheses and a description of the key 
variables involved in each. In the first case, a regional grocery chain is considering offering a deliv- 
ery service that would allow consumers to purchase groceries via the store Web site. They have 
conducted a trial of this in one market and have conducted a survey in that area. In the second 
case, a Korean automobile company is considering offering one of its models for sale in Europe. 
The company has also conducted a survey in two key European auto markets. 


Write Research Objectives and Questions 


Both managers and researchers expect problem-definition efforts to result in statements of research 
questions and research objectives. At the end of the problem-definition stage, the researcher 
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Example Business Decision Situations, Corresponding Research Hypotheses, and Variable Descriptions 


Managerial Decision Research Question(s) Continuous Variable(s) 


Research Hypotheses 


Categorical Variable(s) 


Retail grocer considering 
Web-based delivery 
service 


What market segments 
should be served? 


Is there sufficient 
demand? 


How much should 
delivery personnel be 
paid? 


Will delivery service (new 
retail form) cannibalize 
current business? 


Does nationality matter? 
Will French and German 
consumers express 
interest in our product? 


Does the attitude toward 
Korean companies 
influence purchase 
intentions? 


Projected sales volume will 
exceed $5 M annually. 


Delivery personnel can 
be paid less than cashiers 
and achieve the same job 
satisfaction. 


Web customers express 
lower intentions to 

visit store than other 
customers. 


French consumers have 
more interest in purchasing 
our product than German 
consumers. 


Attitude toward Korean 
companies is related 
positively to product 
purchase interest. 


Type of employee 
(delivery, cashier, etc.) 


Retail form (independent 
variable): classifies 
respondents based on 
whether they shopped 
(1) in store or (2) via the 
Web (delivery). 


Nationality (independent 
variable): represents 
which country a survey 
respondent lives in: 

(1) France (2) Germany. 


Sales volume: dollar 
amount based on a test 
trial in one geographic 
market (i.e., Phoenix/ 
Scottsdale). 


Hourly wages and 
satisfaction with pay. 


Intentions to visit store 
(dependent variable): the 
percentage likelihood 
that a survey respondent 
would visit the store 
within the next 7 days. 


Attitude toward Korean 
companies (independent 
variable): ratings scale that 
describes how favorably 
survey respondents 

view Korean companies 
(quality, reputation, 
value—higher scores 
mean better attitude). 


Product purchase 
interest: ratings scale that 
shows how interested a 
consumer is in buying the 
Korean product (higher 
scores = more interest). 


should prepare a written statement that clarifies any ambiguity about what the research hopes to 
accomplish. This completes the translation process. 


Research questions express the research objectives in terms of questions that can be addressed research questions 


by research. For example, one of the key research questions involved in the opening vignette is Express the research objectives 
in terms of questions that can be 


addressed by research. 


“Are wages and long-haul distance related to driver loyalty and retention?” Hypotheses are more 
specific than research questions. One key distinction between research questions and hypotheses 
is that hypotheses can generally specify the direction of a relationship. In other words, when an 
independent variable goes up, we have sufficient knowledge to predict that the dependent vari- 
able should also go up (or down as the case may be). One key research hypothesis for Deland 
Trucking is: 


Higher cents per mile are related positively to driver loyalty. 


At times, a researcher may suspect that two variables are related but have insufficient theoreti- 
cal rationale to support the relationship as positive or negative. In this case, hypotheses cannot 
be offered. At times in research, particularly in exploratory research, a proposal can only offer 
research questions. Research hypotheses are much more specific and therefore require consider- 
ably more theoretical support. In addition, research questions are interrogative, whereas research 


hypotheses are declarative. —Bill Cosby 


Clarity in Research Questions and Hypotheses 


Research questions make it easier to understand what is perplexing managers and to indicate what 
issues have to be resolved. A research question is the researcher’s translation of the marketing 
problem into a specific inquiry. 


Pricing Turbulence 
A heavy equipment distributor sought out research because 

it believed there was an opportunity to increase revenues by 
raising prices. After several weeks of discussion, interviews, and 
proposal reviews, they settled on a decision question that asked, 
“In what ways could revenues be increased by altering pricing 
policies across customers?” A research project was conducted 
that offered the following deliverables: (1) demonstrate how 
much customer characteristics and environmental characteristics 
influence price elasticity and (2) identify market segments based 
on price elasticity. This led to several hypotheses including the 
following: 


H1: The desired delivery time for equipment is negatively related to 


In other words, the more critical a piece 
of heavy equipment is to a company, the 
less concerned they are with the price. 
Similarly, customers are less concerned with 
price in markets that are more turbulent, 
meaning there are ever-changing environmen- 

tal, competitive, and political pressures. 

A study of heavy equipment purchasers around the world 
supported both hypotheses. For business segments where deliv- 
ery time is of critical importance, higher prices can be charged 
without the fear of losing business. Similarly, in turbulent inter- 
national markets, customers have other important concerns that 
make them less sensitive to equipment price and more sensitive 
to reliability and service. In the end, the heavy equipment com- 


price sensitivity. i , pany was able to build customer characteristics data into a DSS 
H2: The degree of market turbulence is negatively related to price system that automated prices. 
sensitivity. Interestingly, management did not express any concerns 


about either market segments or market turbulence in the initial 
interviews. Thus, this research succeeded because good research 
objectives, questions, and hypotheses were developed before 
any study was implemented. 


In addition, a research question specifically addressing mar- 
ket segments was asked: 


RQ1: Are there market seg- 
ments that can be identified 
based on customers’ desired 
benefits or environmental 
characteristics? 


Sources: Smith, M.F., |. Sinha, R. Lancianai, and H. Forman, “Role of Market 
Turbulence in Shaping Pricing,” Industrial Marketing Management 28 (November 
1999), 637-649; Peters, G., “Combating Too Much Information,” Industrial 
Distribution 94 (December 2005), 22. 
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A research question can be too vague and general, such as “Is advertising copy 1 better than 
advertising copy 2?” Advertising effectiveness can be variously measured by sales, recall of sales 
message, brand awareness, intention to buy, recognition, or knowledge, to name a few possibili- 
ties. Asking a more specific research question (such as, “Which advertisement has a higher day- 
after recall score?”) helps the researcher design a study that will produce useful results, as seen in 
the Research Snapshot above. Research question answers should provide input that can be used 
as a standard for selecting from among alternative solutions. Problem definition seeks to state 
research questions clearly and to develop well-formulated, specific hypotheses. 

A sales manager may hypothesize that salespeople who show the highest job satisfaction will 
be the most productive. An advertising manager may believe that if consumers’ attitudes toward 
a product are changed in a positive direction, consumption of the product also will increase. 
Hypotheses are statements that can be empirically tested. 

A formal hypothesis has considerable practical value in planning and designing research. It 
forces researchers to be clear about what they expect to find through the study, and it raises crucial 
questions about data required. When evaluating a hypothesis, researchers should ensure that the 
information collected will be useful in decision making. Notice how the following hypotheses 
express expected relationships between variables: 


e There is a positive relationship between buying on the Internet and the presence of younger chil- 
dren in the home. 

e Sales are lower for salespeople in regions that receive less advertising support. 

e Consumers will experience cognitive dissonance after the decision to adopt a TiVo personal video 
recorder. 

e Opinion leaders are more affected by mass media communication sources than are non-leaders. 

e Among non-exporters, the degree of perceived importance of overcoming barriers to export- 
ing is related positively to general interest in exporting (export intentions).* 


Management is often faced with a “go/no go” decision. In such cases, a research question 
or hypothesis may be expressed in terms of a meaningful barrier that represents the turning 
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point in such a decision. In this case, the research involves a managerial action standard that 
specifies a specific performance criterion upon which a decision can be based. If the criterion 
to be measured (for example, sales or attitude changes) turns out to be higher than some pre- 
determined level, management will do A; if it is lower, management will do B.’ In Exhibit 6.6, 
the specified sales volume of $5 million represents a managerial action standard for the retail 
grocery chain. 

Research objectives also should be limited to a manageable number. Fewer study objectives 
make it easier to ensure that each will be addressed fully. It becomes easy to lose focus with too 
many research objectives. 

Exhibit 6.7 summarizes how a decision statement (corresponding to a business research prob- 
lem) leads to research objectives that become a basis for the research design. Once the research 
has been conducted, the results may show an unanticipated aspect of the problem and suggest a 
need for additional research to satisfy the main objective. Accomplished researchers who have 
had the experience of uncovering additional aspects of a particular research problem after fin- 
ishing fieldwork recommend designing studies that include questions designed to reveal the 
unexpected. 


How Much Time Should Be Spent 
on Problem Definition? 


Budget constraints usually influence how much effort is spent on problem definition. Busi- 
ness situations can be complex and numerous variables may be relevant. Searching for every 
conceivable cause and minor influence is impractical. The more important the decision faced 
by management, the more resources should be allocated toward problem definition. While not 
a guarantee, allowing more time and spending more money will help make sure the research 
objectives that result are relevant and can demonstrate which influences management should 
focus on. 

Managers, being responsible for decision making, may wish the problem-definition process 
to proceed quickly. Researchers who take a long time to produce a set of research objectives 
can frustrate managers. However, the time taken to identify the correct problem is usually time 
well spent. 
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managerial action 
standard 


A specific performance criterion 
upon which a decision can be 
based. 


EXHIBIT 6.7 

Influence of Decision 
Statement of Marketing 
Problem on Research 
Objectives and Research 
Designs 
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The Research Proposal 


research proposal The research proposal is a written statement of the research design. It always includes a statement 


A written statement ofthe explaining the purpose of the study (in the form of research objectives or deliverables) and a defi- 


research design. nition of the problem, often in the form of a decision statement. A good proposal systematically 
outlines the particular research methodology and details procedures that will be used during each 
stage of the research process. Normally a schedule of costs and deadlines is included in the research 
proposal. The research proposal becomes the primary communication document between the 
researcher and the research user. 

Exhibit 6.8 illustrates an abbreviated proposal for a short research project conducted for the 
Internal Revenue Service (IRS) that explores public attitudes toward a variety of tax-related 


issues. 


An Abbreviated Version of a Research Proposal for the IRS 


Current Situation 
Public perception of the IRS appears to be extremely negative. The 
IRS is the brunt of jokes, and the public avoids contact with any 
IRS entity. As a result, taxpayers are more inclined to cheat on their 
returns and many services provided by the IRS to assist taxpayers in 
preparing their tax returns and to help them understand ways they 
can avoid paying unnecessary taxes and penalties go unused. In 
addition, negative attitude lessens the Service's ability to effectively 
lobby for policy changes. The key decision faced by the IRS due to 
this situation can be stated as, 

What steps could be taken to effectively improve consumer 
perceptions of the IRS and help design more user-friendly 
services? 


Purpose of the Research 

The general purpose of the study is to determine the taxpaying 
public's perceptions of the role of the IRS in administering the tax 
laws. In defining the limits of this study, the IRS identified the study 
areas to be addressed. A careful review of those areas led to the 
identification of the following specific research objectives: 


1. To identify the extent to which taxpayers cheat on their returns, 
their reasons for doing so, and approaches that can be taken to 
deter this kind of behavior 

2. To determine taxpayers’ experience and level of satisfaction with 
various IRS services 

3. To determine what services taxpayers need 

4. To develop an accurate profile of taxpayers’ behavior relative to 
the preparation of their income tax returns 

5. To assess taxpayers’ knowledge and opinions about various tax 
laws and procedures 


Research Design 
The survey research method will be the basic research design. 
Each respondent will be interviewed in his or her home. The 
personal interviews are generally expected to last between 35 and 
45 minutes, although the length will vary depending on the 
previous tax-related experiences of the respondent. For example, 
if a respondent has never been audited, questions on audit 
experience will not be addressed. Or, if a respondent has never 
contacted the IRS for assistance, certain questions concerning 
reactions to IRS services will be skipped. 

Some sample questions that will be asked are 


Did you or your spouse prepare your federal tax return for 
(year)? 

O Self 

LI Spouse 

LI Someone else 


Did the federal income tax package you received in the mail 
contain all the forms necessary for you to fill out your return? 


Yes 

No 

Didn’t receive one in the mail 
Don’t know 


If you were calling the IRS for assistance and no one was able to 
help you immediately, would you rather get a busy signal or be 
asked to wait on hold? 


Busy signal 
Wait on hold 
Neither 
Don’t know 


During the interview a self-administered questionnaire will be given 
to the taxpayer to ask certain sensitive questions, such as 


Have you ever claimed a dependent on your tax return that you 
weren't really entitled to? 


Yes 
No 


Sample Design 

A survey of approximately 5,000 individuals located in 50 counties 
throughout the country will provide the database for this study. The 
sample will be selected on a probability basis from all households in 
the continental United States. 

Eligible respondents will be adults over the age of 18. Within 
each household an effort will be made to interview the individual 
who is most familiar with completing the federal tax forms. When 
there is more than one taxpayer in the household, a random process 
will be used to select the taxpayer to be interviewed. 


Data Gathering 
The fieldworkers of a consulting organization will conduct the interviews. 


Data Processing and Analysis 
Standard editing and coding procedures will be utilized. Simple 
tabulation and cross-tabulations will be utilized to analyze the data. 


Report Preparation 

A written report will be prepared, and an oral presentation 
of the findings will be made by the research analyst at the 
convenience of the IRS. 


Budget and Time Schedule 

Any complete research proposal should include a schedule of 
how long it will take to conduct each stage of the research and a 
statement of itemized costs. 


Based on A General Taxpayer Opinion Survey, Office of Planning and Research, Internal Revenue Service, March 1980. 
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The Proposal as a Planning Tool 


Preparation of a research proposal forces the researcher to think critically about each stage of the 
research process. Vague plans, abstract ideas, and sweeping generalizations about problems or 
procedures must become concrete and precise statements about specific events. Data requirements 
and research procedures must be specified clearly so others may understand their exact implica- 
tions. All ambiguities about why and how the research will be conducted must be clarified before 
the proposal is complete. 

The researcher submits the proposal to management for acceptance, modification, or rejec- 
tion. Research clients (management) evaluate the proposed study with particular emphasis on 
whether or not it will provide useful information, and whether it will do so within a reasonable 
resource budget. Initial proposals are almost always revised after the first review. 

The proposal helps managers decide if the proper information will be obtained and if the 
proposed research will accomplish what is desired. If the problem has not been adequately 
translated into a set of specific research objectives and a research design, the client’s assessment 
of the proposal will help ensure that the researchers revise it to meet the client’s information 
needs. 

An effective proposal communicates exactly what information will be obtained, where 
it will be obtained, and how it will be obtained. For this reason, it must be explicit about 
sample selection, measurement, fieldwork, and data analysis. For instance, most proposals 
involving descriptive research include a proposed questionnaire (or at least some sample 
questions). 

The format for the IRS research proposal in Exhibit 6.8 follows the six stages in the 
research process outlined in Chapter 4. At each stage, one or more questions must be answered 
before the researcher can select one of the various alternatives. For example, before a proposal 
can be completed, the researcher needs to know what is to be measured. A simple statement 
like “market share” may not be enough; market share may be measured by auditing retail- 
ers’ or wholesalers’ sales, using trade association data, or asking consumers what brands they 
buy. What is to be measured is just 
one of many important questions that 
must be answered before setting the 
research process in motion. Exhibit 
6.9 on the next page presents an over- 
view of some of the basic questions 
that managers and researchers typically 
must answer when planning a research 
design. 


The Proposal as 
a Contract 


When the research will be conducted 
by a consultant or an outside research 
supplier, the written proposal serves as 
that person’s bid to offer a specific ser- 
vice. Typically, a client solicits several 
competitive proposals, and these writ- 
ten offers help management judge the 
relative quality of alternative research 
suppliers. 

A wise researcher will not agree to 
do a research job for which no written 
proposal exists. The proposal also serves 
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Congress fights about 
everything . . . including how 
to spend taxpayers’ money on 
federal research grants. 
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Basic Points Addressed by Research Proposals 


Decisions to Make Basic Questions 


Problem definition What is the purpose of the study? 
How much is already known? 
Is additional background information necessary? 
What is to be measured? How? 
Can the data be made available? 
Should research be conducted? 
Can a hypothesis be formulated? 


Selection of basic research design What types of questions need to be answered? 
Are descriptive or causal findings required? 
What is the source of the data? 
Can objective answers be obtained by asking people? 
How quickly is the information needed? 
How should survey questions be worded? 
How should experimental manipulations be made? 


Selection of sample Who or what is the source of the data? 
Can the target population be identified? 
Is a sample necessary? 
How accurate must the sample be? 
Is a probability sample necessary? 
Is a national sample necessary? 
How large a sample is necessary? 
How will the sample be selected? 


Data gathering Who will gather the data? 
How long will data gathering take? 
How much supervision is needed? 
What procedures will data collectors need to follow? 


Data analysis and evaluation Will standardized editing and coding procedures be used? 
How will the data be categorized? 
Will computer or hand tabulation be used? 
What is the nature of the data? 
What questions need to be answered? 
How many variables are to be investigated simultaneously? 
What are the criteria for evaluation of performance? 
What statistical tools are appropriate? 


Type of report Who will read the report? 
Are managerial recommendations requested? 
How many presentations are required? 
What will be the format of the written report? 


Overall evaluation How much will the study cost? 
Is the time frame acceptable? 
Is outside help needed? 
Will this research design attain the stated research objectives? 
When should the research begin? 


as a contract that describes the product the research user will buy. In fact, the proposal is in many 
ways the same as the final research report without the actual results. Misstatements and faulty com- 
munication may occur if the parties rely only on each individuals memory of what occurred at a 
planning meeting. The proposal creates a record, which greatly reduces conflicts that might arise 
after the research has been conducted. Both the researcher and the research client should sign the 
proposal indicating agreement on what will be done. 
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The proposal then functions as a formal, written statement of agreement between marketing 
executives and researchers. As such, it protects the researcher from criticisms such as, “Shouldn’t 
we have had a larger sample?” or “Why didn’t you use a focus group approach?” As a record of the 
researcher’s obligation, the proposal also provides a standard for determining whether the actual 
research was conducted as originally planned. 

Suppose in our Deland Trucking case, following the research, David is unhappy with the 
nature of the results because they indicate that higher cents per mile do, in fact, impact driver 
loyalty. This is something that David may not wish to face. In his despair, he complains to James 
saying, 


“What I really wanted was a recruitment expense study, yet you provide results indicating my wages are 
too low! Why should I pay you?” 


James can refer back to the research proposal, which is signed by David. He can point right to 
the deliverables described above showing that David agreed to a study involving driver loyalty and 
the organizational characteristics that lead to loyalty. The proposal certainly protects the researcher 
in this case. In most cases like this, after the initial emotional reaction to unflattering results, the 
client comes around and realizes the report contents include information that will be helpful. 
Realize too that the proposal protects David in case James produced a study that addresses only 
research objectives not included in the proposal. 

In basic research efforts, a formal proposal serves much the same purpose. Funded business 
research generally refers to basic research usually performed by academic researchers and 
supported by some public or private institution. Most commonly, researchers pursue federal 
government grants. A very detailed proposal is usually needed for federal grants, and the agree- 
ment for funding is predicated on the research actually delivering the results described in the 
proposal. 

One important comment needs to be made about the nature of research proposals. Not 
all proposals follow the same format. A researcher can adapt his or her proposal to the target 
audience or situation. An extremely brief proposal submitted by an organization’s internal 
research department to its own executives bears little resemblance to a complex proposal sub- 
mitted by a university professor to a federal government agency to research a basic consumer 
issue. 


Anticipating Outcomes 


As mentioned above, the proposal and the final research report will contain much of the same 
information. The proposal describes the data collection, measurement, data analysis, and so forth, 
in future tense. In the report, the actual results are presented. In this sense, the proposal anticipates 
the research outcome. 

Experienced researchers know that research fails more often because the problem-definition 
process breaks down or because the research client never truly understood what a research project 
could or couldn’t do. While it probably seems as though the proposal should make this clear, any 
shortcoming in the proposal can contribute to a communication failure. Thus, any tool that helps 
communication become as clear as can be is valued very highly. 


DUMMY TABLES 


One such tool that is perhaps the best way to let management know exactly what kind of results 
will be produced by research is the dummy table. Dummy tables are placed in research propos- 
als and are exact representations of the actual tables that will show results in the final report 
with one exception: The results are hypothetical. They get the name because the researcher 
fills in, or “dummies up,” the tables with likely but fictitious data. Dummy tables include the 
tables that will present hypothesis test results. In this way, they are linked directly to research 
objectives. 
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funded business research 


Refers to basic research usually 
performed by academic research- 
ers that is financially supported 
by some public or private institu- 
tion, as in federal government 
grants. 


dummy tables 


Tables placed in research propos- 
als that are exact representations 
of the actual tables that will show 
results in the final report with 

the exception that the results are 
hypothetical (fictitious). 


EXHIBIT 6.10 
A Dummy Table for David 
Deland 
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Researchers should allocate a substantial amount of time 

toward identifying and refining decision statements, research 

problems and questions, and research hypotheses. This is a 

way that the relevance of the research can be increased. 

Use qualitative research tools to probe the key decision mak- 

ers during early interviews. 

e Ask what has changed. 

e Ask the decision maker to tell more about situations for 
clarification. 

e Ask the decision maker to compare and contrast 
situations. 


A research analyst can present dummy tables to the decision maker and ask, “Given findings 
like these, will you be able to make a decision?” If the decision maker says yes, the proposal may 
be accepted. However, if the decision maker cannot see how results like those in the dummy 
tables will help make the needed decision(s), it may be back to the drawing board. In other words, 
the client and researcher need to rethink what research results are necessary to solve the problem. 
Sometimes, examining the dummy tables may reveal that a key variable is missing or that some 
dependent variable is really not relevant. In other words, the problem is clarified by deciding on 
action standards or performance criteria and recognizing the types of research findings necessary 


to make specific decisions. 


Express decision statements in creative 

terms whenever possible. For example, 

state them in plural form by using terms 

such as “what ways” might solve a problem 

rather than trying to find “the way” to solve a 

problem. 

Research questions and research hypotheses clearly identify 
the variables that need to be studied. 

Dummy tables are a very effective way to communicate 
exactly how a research problem might be linked to better 
decision making. 


E EXAMPLE DUMMY TABLE 


Exhibit 6.10 shows a dummy table taken from the research proposal for David Deland’s truck- 
ing company. From it, David can see that it shows what things most determine driver loyalty. 
If the results turn out as shown in the dummy table, it would suggest that David needs to per- 
haps increase his compensation or reduce the number of long-haul routes that his drivers must 


conduct. 


While some tables may require some additional explanation from the researcher, every effort 
should be made to allow tables to stand alone and be interpreted by someone who is not an expe- 
rienced researcher. In other words, the user should be able to understand the results and surmise 
implications that the results imply. When the final report is compiled, these tables will be included 


with the dummy results replaced with the actual research results. 


Increase cents/mile 


Number of long-haul routes (per month) 


Days off (per month) 
Vehicle quality 


Benefits provided 


* p-value < .01 
** p-value < .05 


Regression Table: Results Showing Which Variables Determine Driver Loyalty 


Standardized 


Regression Coefficient Rank (Importance) 
50 1 
— 45%* 2 
305% 3 
25% 4 
lS 5 
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Summary 


1. Explain why proper “problem definition” is essential to useful business research. Problem 
definition is the process of defining and developing a decision statement and the steps involved 
in translating it into more precise research terminology, including a set of research objectives. 
While it is difficult to point to any particular research stage as the most important, a strong case 
can be made for this, the first stage. If this step falls apart, the entire research design is misguided. 
Effective problem definition helps make sure the research objectives are relevant and useful— 
meaning the results will actually be used. If problem definition is glossed over or done poorly, 
the results are likely irrelevant and potentially harmful. 


2. Know how to recognize problems. Problems and opportunities are usually associated with 
differences. The differences can occur because of changes in some situation, or they can occur 
because expectations were unrealistic. Problems occur when there is a difference, or gap, between 
the current situation and a more ideal situation. One very common type of gap is when business 
performance does not match the expectations of performance in that dimension. In addition, 
opportunities exist when actual performance in some area does not match the potential perfor- 
mance. Research can supply information to help close the gap. Thus, problems are noticed by 
spotting these gaps. While many of these gaps may just be symptoms, further steps are taken to 
make sure that research addresses relevant issues, not just symptoms. 


3. Translate managerial decision statements into relevant research objectives. The problem- 
definition process outlined in the chapter can help make sure that the research objectives are rel- 
evant. A situation analysis is helpful in this regard. In particular, interviews that identify symptoms 
and then probe the respondent for potential causes of these symptoms are helpful. One tool to 
help in this process is the “what has changed?” technique. The research objectives, once written, 
also indicate what variables are likely needed in the study. 


4. Translate research objectives into research questions and/or research hypotheses. Research 
questions simply restate the research objectives in the form of a question. When the researcher 
has sufficient theoretical reasoning to make a more specific prediction that includes the direction 
of any predicted relationship, the research question can be translated into one or more research 
hypotheses. 


5. Outline the components of a research proposal. The research proposal is a written statement of 
the research design that will be followed in addressing a specific problem. The research proposal 
allows managers to evaluate the details of the proposed research and determine if alterations are 
needed. Most research proposals include the following sections: decision description, purpose of 
the research including the research objectives, research design, sample design, data gathering and/ 
or fieldwork techniques, data processing and analysis, budget, and time schedule. 


6. Construct dummy tables as part of a research proposal. Dummy tables are included in research 
proposals and look exactly like the real tables that will be included in the final research report. 
However, they cannot actually contain results since the study has not yet been done. So, they 
include hypothetical results that look as much as possible like the actual results. These tables are 
a very good tool for communicating the value of a research project to management because they 
provide a real sense for implications that may result from the research. 


Key Terms and Concepts 


categorical variable, 119 funded business research, 127 research proposal, 124 
classificatory variable, 119 independent variable, 120 research questions, 121 
constant, 119 interrogative techniques, 114 situation analysis, 112 
continuous variable, 119 managerial action standard, 123 unit of analysis, 119 
decision statement, 108 probing, 114 variable, 119 
dependent variable, 120 problem, 112 


dummy tables, 127 problem definition, 108 
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Part 2: Beginning Stages of the Research Process 


Questions for Review and Critical Thinking 


10. 


11. 


12. 


13; 


14. 


. What is a decision statement? How does the focus on an irrel- 


evant decision affect the research process? 


. Define problem recognition. How is this process like translating 


text from one language into another? What role does “probing” 
play in this process? 


. List and describe four factors that influence how difficult the 


problem-definition process can be. 


. What are three types of gaps that exist, indicating that research 


may be needed to assist a business in making some decision? 


. Examine an article in the Wall Street Journal or a similar source 


that discusses a business situation of a company in the electron- 
ics or defense industry. Identify a problem that exists with the 
company. Develop some research objectives that you believe 
correspond to the problem. 


. What is a situation analysis? How can it be used to separate 


symptoms from actual problems? 


. Define unit of analysis in a marketing research context. 
. Find some business journal articles that deal with culture and 


international expansion. Find one that lists some hypotheses. 
What kinds of decisions might be assisted by the results of 
testing these hypotheses? 


. List and describe at least four terms that can describe the nature 


of a variable. 

For each of the following variables, explain why it should be 

considered either continuous or categorical: 

a. Whether or not a university played in a football bowl game 
during 2006 

b. The average wait time a customer has before being served 
in a full-service restaurant 

c. Letter grades of A, B, C, D, or F 

d. The job satisfaction of a company’s salespeople 

e. A consumer’s age 

Write at least three examples of hypotheses that involve a 

managerial action statement. Provide a corresponding decision 

statement for each. 

What are the major components of a research proposal? How 

does a research proposal assist the researcher? 

The chapter provides an example dummy table for the Deland 

Trucking vignette. Provide another example dummy table that 

corresponds to this same situation. 

Evaluate the following statements of business research prob- 

lems. For each provide a decision statement and corresponding 

research objectives: 

a. A farm implement manufacturer: Our objective is to learn 
the most effective form of advertising so we can maximize 
product line profits. 


Research Activities 


‘NET Examine the Web site for International Communications 
Research (http://icrsurvey.com).'” What services do they seem to 
offer that fall into the problem-definition process? 

Consider the current situation within your local university 
music department. Assuming it stages musical productions to 


15; 


16. 


17: 


b. An employees’ credit union: Our problem is to determine 
the reasons why employees join the credit union, deter- 
mine members’ awareness of credit union services, and 
measure attitudes and beliefs about how effectively the 
credit union is operated. 

c. The producer of a television show: We have a marketing 
problem. The program’s ratings are low. We need to learn 
how we can improve our ratings. 

d. A soft-drink manufacturer: The marketing problem is that 
we do not know if our bottlers are more satisfied with us 
than our competitors’ bottlers are with them. 

e. A women’s magazine: Our problem is to document the 
demographic changes that have occurred in recent decades 
in the lives of women and to put them in historical per- 
spective; to examine several generations of American 
women through most of this century, tracking their roles 
as students, workers, wives, and mothers and noting the 
changes in timing, sequence, and duration of these roles; 
to examine at what age and for how long a woman enters 
various stages of her life: school, work, marriage, childbear- 
ing, divorce. This will be accomplished by analyzing demo- 
graphic data over several generations. 

f. A manufacturer of fishing boats: The problem is to deter- 
mine sales trends over the past five years by product cat- 
egory and to determine the seasonality of unit boat sales by 
quarters and by region of the country. 

g. The inventor of a tension-headache remedy (a cooling pad 
that is placed on the forehead for up to four hours): The 
purpose of this research is (1) to identify the market poten- 
tial for the product, (2) to identify what desirable features 
the product should possess, and (3) to determine possible 
advertising strategies/channel strategies for the product. 

Comment on the following statements and situations: 

a. “The best researchers are prepared to rethink and rewrite 
their proposals.” 

b. “The client’s signature is an essential element of the research 
proposal.” 

You have been hired by a group of hotel owners, restaurant 

owners, and other people engaged in businesses that benefit from 

tourism on South Padre Island, Texas. They wish to learn how 
they can attract a large number of college students to their town 
during spring break. Define the marketing decision statement. 

You have been hired by a local Big Brothers and Big Sisters 

organization to learn how they can increase the number of 

males who volunteer to become Big Brothers to fatherless boys. 

Define your research objectives. 


which audiences are invited and for which tickets are sold, 
describe the marketing situation it faces. Prepare a research 
proposal that would help it address a key decision. Make sure 
it includes at least one dummy table. 
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Case 6.1 E-ZPass 


4 In the 1990s, a task force was formed among 
executives of seven regional transportation 


agencies in the New York-New Jersey area." 

The mission of the task force was to investi- 

gate the feasibility and desirability of adopting 
| electronic toll collection (ETC) for the inter- 
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regional roadways of the area. Electronic toll collection is accom- 
plished by providing commuters with small transceivers (tags) that 
emit a tuned radio signal. Receivers placed at tollbooths are able 
to receive the radio signal and identify the commuter associated 
with the particular signal. Commuters establish ETC accounts 
that are debited for each use of a toll road or facility, thus elimi- 
nating the need for the commuter to pay by cash or token. 
Because the radio signal can be read from a car in motion, ETC 
can reduce traffic jams at toll plazas by allowing tag holders to 
pass through at moderate speeds. 

At the time the New York and New Jersey agencies were 
studying the service, electronic toll collection was already being 
used successfully in Texas and Louisiana. Even though several of 
the agencies had individually considered implementing ETC, they 
recognized that independent adoption would fall far short of the 
potential benefits achievable with an integrated interregional system. 

The task force was most interested in identifying the ideal 
configuration of service attributes for each agency’s commuters and 
determining how similar or different these configurations might be 


across agencies. The task force identified a lengthy list of attributes 
that was ultimately culled to six questions: 


e How many accounts are necessary and what statements will be 
received? 

e How and where does one pay for E-ZPass? 

e What lanes are available for use and how they are controlled? 

e Is the tag transferable to other vehicles? 

e What is the price of the tag and possible service charge? 

e What are other possible uses for the E-ZPass tag (airport 
parking, gasoline purchases, and so forth)? 


From a researcher's perspective, it also seemed important to 
assess commuter demand for the service. However, the task force 
was not convinced that it needed a projection of demand, because 
it was committed to implementing ETC regardless of initial com- 
muter acceptance. The task force considered its primary role to be 
investigating commuters’ preferences for how the service should be 
configured ideally. 


Questions 

1. Evaluate the problem-definition process. Has the problem been 
defined adequately so that a relevant decision statement can be 
written? 

What type of research design would you recommend for this project? 
What research questions might be tested? 


AON 


What might a dummy table include in this research proposal? 


Case 6.2 Cane’s Goes International 


NW) Raising Cane’s is a fast-food chicken finger 


establishment based in Baton Rouge, Louisiana. 
Cane’s restaurants are popular throughout the 
Gulf South. Cane’s recently has been approached 
by people interested in opening Cane’s restau- 
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rants in other countries. The best contact is an 
Australian. However, Cane’s has also been approached about outlets 
in Montreal, Quebec, and in Monterrey, Mexico. Cane’s prepares 


high-quality fried chicken fingers and has a limited menu consisting 
of fingers, fries, slaw, and lemonade (http://www.raisingcanes.com). 


Write a decision statement for Raising Cane’s. 
Write corresponding research objectives and research questions. 


aed: 


What role would a proposal play in assisting this research effort 
and in assisting Cane’s in improving their business situation? 


Case 6.3 Deland Trucking 


NW) Based on the case scenario described throughout 
this chapter, prepare a research proposal that 


addresses this situation. 


© GETTY IMAGES/ 
PHOTODISC GREEN 


CHAPTER 7 
QUALITATIVE 
RESEARCH TOOLS 


After studying this chapter, you should be able to 
List and understand the differences between qualitative 
research and quantitative research 
2. Understand the role of qualitative research in explor- 
atory research designs 
3. Describe the basic qualitative research orientations 
4. Prepare a focus group interview outline 
5. Recognize technological advances in the application of 
qualitative research approaches 
6. Recognize common qualitative research tools and know 
the advantages and limitations of their use 
7. Know the risks associated with acting on only explor- 


ils 


atory results 


Chapter Vignette: What’s in the Van? 


Is this shoe too cool? That was really the question asked by VF Corporation when they acquired 


Vans, the company that makes the shoe shown here.' Vans traditionally are synonymous with 
skateboarding and skateboard culture. Readers that are unfamiliar with skateboarding may well 
have never heard of the company. However, a reader that is part of the skateboard culture is 


probably looking down at his or her Vans right now! 
Former Vans CEO Gary Schoenfeld points out that a decade before the acquisition (a 


$396 million deal), Vans was practically a dead brand.” However, the last ten years have seen 


LIP-ON 


COURTESY, VANS CLASSIC 5 


a revival in skateboard interest and Vans has remained the number 
one skateboard shoe provider. Now, the incoming management 
team has been given the task of deciding how to raise Vans sales to 
$500 million per year. 

Where will the growth come from? Should the company define 
itself as a “skateboard footwear” company, a “lifestyle” company, or 
as the icon for the skate culture? Answering this question will require 
a deeper interpretation of the meaning of the “Van.” 

Skateboarding is a dynamic activity. A study by Board-Trac sug- 
gests that today over one in four skateboarders is female, as opposed 
to fewer than one in ten as recently as 2000.3 So, what exactly is in the 


mind and heart of a “boarder”? Two important research questions involve “What is the meaning 


of a pair of Vans?” and “What things define the skateboarding experience?” 
Questions like these call for qualitative research methods.* Not just any researcher is “fit” for 


this job. One way to collect this data is to hire young, energetic research employees to become 


“boarders” and immerse themselves into the culture. 
They may have to “Kasper” like a “flatland techer” while probing for meaning among the dis- 


cussion and activities of the other boarders. Here, Vans may find that their brand helps identify a 
boarder and make them feel unique in some ways. If so, Vans may want to investigate increasing 


their product line beyond shoes and simple apparel. 
Depth interviews of Vans wearers in which people describe in detail why they wear Vans will 


also be useful. Vans shouldn't be surprised if they find a significant portion of their shoes are sold 
to people like Mr. Samuel Teel, a retired attorney from Toledo, Ohio. Sam is completely unaware 
of the connection between Vans and skateboarding. He likes them because he doesn’t have to 
bend to tie his shoes! Maybe there are some secondary segments that could bring growth to 


Vans. But marketing to them could complicate things—who knows? 
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Introduction 


Chemists sometimes use the term qualitative analysis to mean research that determines what some 
compound is made of. In other words, the focus is on the inner meaning of the chemical—its 
qualities. As the word implies, qualitative research is interested more in qualities than quantities. 
Therefore, qualitative research is not about applying specific numbers to measure variables or 
using statistical procedures to numerically specify a relationship’s strength. 


What Is Qualitative Research? 


Qualitative business research is research that addresses business objectives through techniques that 
allow the researcher to provide elaborate interpretations of market phenomena without depend- 
ing on numerical measurement. Its focus is on discovering true inner meanings and new insights. 
Qualitative research is very widely applied in practice. There are many research firms that special- 
ize in qualitative research. 

Qualitative research is less structured than most quantitative approaches. It does not rely on self- 
response questionnaires containing structured response formats. Instead, itis more researcher-dependent 
in that the researcher must extract meaning from unstructured responses, such as text from a recorded 
interview or a collage representing the meaning of some experience, such as skateboarding. The 
researcher interprets the data to extract its meaning and converts it to information. 


Uses of Qualitative Research 


Mechanics can’t use a hammer to fix everything that is broken. Instead, the mechanic has a tool- 
box from which a tool is matched to a problem. Business research is the same. The researcher 
has many tools available and the research design should try to match the best tool to the research 
objective. Also, just as a mechanic is probably not an expert with every tool, each researcher 
usually has special expertise with a small number of tools. Not every researcher has expertise with 
tools that would comprise qualitative research. 

Generally, the less specific the research objective, the more likely that qualitative research 
tools will be appropriate. Also, when the emphasis is on a deeper understanding of motivations or 
on developing novel concepts, qualitative research is very appropriate. The following list repre- 
sents common situations that often call for qualitative research: 


1. When it is difficult to develop specific and actionable problem statements or 
research objectives. For instance, if after several interviews with the research client 
the researcher still can’t determine exactly what needs to be measured, then quali- 
tative research approaches may help with problem definition. Qualitative research 
is often useful to gain further insight and crystallize the research problem. 

When the research objective is to develop an understanding of some phenom- 
ena in great detail and in much depth. Qualitative research tools are aimed at 
discovering the primary themes indicating human motivations and the docu- 


N 


mentation of activities is usually very complete. Often qualitative research pro- 
vides richer information than quantitative approaches. 

3. When the research objective is to learn how a phenomena occurs in its natu- 
ral setting or to learn how to express some concept in colloquial terms. For 
example, how do consumers actually use a product? Or, exactly how does 
the accounting department process invoices? While a survey can probably ask 
many useful questions, observing a product in use or watching the invoice 
process will usually be more insightful. Qualitative research produces many 
product and process improvement ideas. 

4. When some behavior the researcher is studying is particularly context 
dependent—meaning the reasons something is liked or some behavior is per- 
formed depend very much on the particular situation surrounding the event. 
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qualitative business 
research 


Research that addresses business 
objectives through techniques 
that allow the researcher to pro- 
vide elaborate interpretations of 
phenomena without depending 
on numerical measurement; its 
focus is on discovering true inner 
meanings and new insights. 


researcher-dependent 


Research in which the researcher 
must extract meaning from 
unstructured responses such as 
text from a recorded interview or 
a collage representing the mean- 
ing of some experience. 


Qualitative researchers can 
learn about the skating 
experience by becoming 
immersed in the culture. 


a 
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quantitative business 
research 


Business research that addresses 


research objectives through 
empirical assessments that 


involve numerical measurement 
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and analysis. 


We have been working with the 

online survey in this class. This sur- 

vey primarily deals with quantitative 

information rather than qualitative 

information. However, the question 

that asks the respondent to provide 

suggestions about improving the quality of business 
education at your school is qualitative in nature. 
Look over the comments provided by the students 
in your class. First, read through all the comments. 
Then, identify the major themes or issues that are 
present. You should be able to identify a small num- 
ber of issues that are mentioned by multiple respon- 
dents. Based on these comments, what suggestion 
would you offer administrators at your school for 
improving the educational environment? 


Understanding why Vans are liked is probably difficult to determine correctly outside the 
skating environment. 

5. When a fresh approach to studying some problem is needed. This is particularly the case when 
quantitative research has yielded less than satisfying results. Qualitative tools can yield unique 
insights, many of which may lead the organization in new directions. 


Each of these describes a scenario that may require an exploratory orientation. Previously, we 
defined exploratory research as appropriate in ambiguous situations or when new insight is 
needed. We indicated that exploratory research approaches are sometimes needed just to reach the 
appropriate problem statement and research objectives. While equating qualitative research with 
exploratory research is an oversimplification, the application of qualitative tools can help clear up 
ambiguity and provide innovative ideas. 


Qualitative “versus” Quantitative Research 


In social science, one can find many debates about the superiority of qualitative research over 
quantitative research or vice versa.° We’ll begin by saying that this is largely a superfluous argu- 
ment in either direction. The truth is that qualitative research can accomplish research objectives 
that quantitative research cannot. Similarly truthful, but no more so, quantitative research can 
accomplish objectives that qualitative research cannot. The key to successfully using either is to 
match the right approach to the right research context. 

Many good research projects combine both qualitative and quantitative research. For instance, 
developing valid survey measures requires first a deep understanding of the concept to be mea- 
sured and a description of the way these ideas are expressed in everyday language. Both of these 
are tasks best suited for qualitative research. However, validating the measure formally to make 
sure it can reliably capture the intended concept will likely require quantitative research.’ Also, 
qualitative research may be needed to separate symptoms from problems and then quantitative 
research can follow up to test relationships among relevant variables. The Research Snapshot on 
the next page describes one such situation.* 

Quantitative business research can be defined as business research that addresses research objec- 
tives through empirical assessments that involve numerical measurement and analysis approaches. 
Qualitative research is more apt to stand on its own in the sense that it requires less interpretation. 
For example, quantitative research is quite appropriate when a research objective involves a mana- 
gerial action standard. For example, a salad dressing company considered changing its recipe.” The 
new recipe was tested with a sample of consumers. Each consumer rated the product using numeric 
scales. Management established a rule that a majority of consumers rating the new product higher 
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l Surprises at P&G! 


techniques including depth interviews, observational techniques 


= With literally thousands of products to (shadowing), and focus groups on P&G managers and marketing 
manage, Procter & Gamble (P&G) finds employees. These interviews gave the researchers the idea that 
itself in the situation to conduct qualitative research perhaps P&G was suffering more from a management problem 

almost daily. P&G doesn’t introduce a product that than from a marketing problem. It helped form a general research 


hasn't been reviewed from nearly every possible angle. Likewise, question that asked whether business problems were really due to 

before taking a product to a new country, you can be confident low morale among the employees. After a lot of qualitative inter- 

that the product has been “focus grouped” in that environment. views with dozens and dozens of P&G employees, a quantitative 
P&G often uses qualitative research techniques to discover study followed up these findings and supported this idea and led 


potential problems or opportunities for the company’s products. For to suggestions for improving employee morale! 


example, focus groups played a major role in Herbal Essences hair 


Sources: Nelson, Emily, “Focus Groupies: P&G Keeps Cincinnati Busy with All Its 


care’s new logo, advertising copy, reformulated ingredients, and new studies,” Wall Street Journal 239 (January 24, 2002), A1, Eastern Edition; Stengel, 


bottle design. The redesigned bottles for shampoo and conditioner J. R. A. L. Dixon, and C. T. Allen, “Listening 


4 : r Begins at Home,” Harvard Business 
bottles are curved in a yin and yang fashion so they can fit together. Review (November 2003), 106-116; 


“That significantly improved conditioner sales, because consumers Chang, Julia, “Designed to Sell: Procter 
are now buying them as a system,” claims P&G's Claudia Kotchka. & Gamble,” Sales and Marketing (April 20, 
4 ` 3 2007), http://www.salesandmarketing. 
At times, P&G seeks outside help for its research. Such was com/msg/content_display/marketing/ 
the case when P&G wanted a study of its own business problems. e3if5981313dc92fc1aa0356d269d91ea74 


The researchers selected began by applying qualitative research (EIS Felby ©, A00). 


than the old product would have to be established with 90 percent confidence before replacing the 
old formula. A project like this can involve both quantitative measurement in the form of numeric 
rating scales and quantitative analysis in the form of applied statistical procedures. 


Contrasting Qualitative and Quantitative Methods 


Exhibit 7.1 on the next page illustrates some differences between qualitative and quantitative 
research. Certainly, these are generalities and exceptions may apply. However, it covers some of 
the key distinctions. The Research Snapshot above also introduces qualitative research. 

Quantitative researchers direct a considerable amount of activity toward measuring concepts 
with scales that either directly or indirectly provide numeric values. The numeric values can then 
be used in statistical computations and hypothesis testing. As will be described in detail later, this 
process involves comparing numbers in some way. In contrast, qualitative researchers are more 
interested in observing, listening, and interpreting. As such, the researcher is intimately involved 
in the research process and in constructing the results. For these reasons, qualitative research is said 
to be more subjective, meaning that the results are researcher-dependent. Different researchers 
may reach different conclusions based on the same interview. In that respect, qualitative research 
lacks intersubjective certifiability (sometimes called intersubjective verifiability), the ability of dif- 
ferent individuals following the same procedures to produce the same results or come to the same 
conclusion. This should not necessarily be considered a weakness of qualitative research; rather it 
is simply a characteristic that yields differing insights. In contrast, when a survey respondent pro- 
vides a commitment score on a quantitative scale, it is thought to be more objective because the 
number will be the same no matter what researcher is involved in the analysis. 

Qualitative research seldom involves samples with hundreds of respondents. Instead, a handful 
of people are usually the source of qualitative data. This is perfectly acceptable in discovery-ori- 
ented research. All ideas would still have to be tested before adopted. Does a smaller sample mean 
that qualitative research is cheaper than qualitative? Perhaps not. Although fewer respondents have 
to be interviewed, the greater researcher involvement in both the data collection and analysis can 
drive up the costs of qualitative research. 

Given the close relationship between qualitative research and exploratory designs, it should not 
be surprising that qualitative research is most often used in exploratory designs. Small samples, inter- 
pretive procedures that require subjective judgments, and the unstructured interview format all make 
traditional hypotheses testing difficult with qualitative research. Thus, these procedures are not best 


subjective 


Results are researcher- 


dependent, meaning different 
researchers may reach different 
conclusions based on the same 


interview. 


intersubjective 
certifiability 


Different individuals following 


the same procedure will produce 
the same results or come to the 


same conclusion. 
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EXHIBIT 7.1 
Comparing Qualitative and 
Quantitative Research 


Qualitative Research 


Discover Ideas, Used in 


Exploratory Research with 
General Research Objects 


Observe and Interpret 


Unstructured, Free-Form 


Part 2: Beginning Stages of the Research Process 


Test Hypotheses or 
Specific Research 
Questions 


Researcher Is 
Intimately Involved. 
Results Are Subjective. 


Measure and Test 


Structured Response 
Categories Provided 


Small Samples—Often 


Researcher Uninvolved 
Observer. Results Are 
Objective. 


Large Samples to 
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Produce Generalizable 
Results (Results That 
Apply to Other 
Situations) 


in Natural Settings 


Exploratory Research 
Designs 


Descriptive and Causal 
Research Designs 


qualitative data 


Data that are not characterized 


by numbers, and instead are 
textual, visual, or oral: focus ison ments. These disadvantages for drawing inferences, however, become advantages when the goal is to 


stories, visual portrayals, mean- draw out potential explanations because the researcher spends more time with each respondent and 


ingful characterizations, inter- js able to explore much more ground due to the flexibility of the procedures. 
pretations, and other expressive 


descriptions. 
quantitativedata Contrasting Exploratory and Confirmatory Research 


R t ph b ign- . . : : 
a TA Philosophically, research can be considered as either exploratory or confirmatory. Most 
ing numbers in an ordered and 


meaningful way, exploratory research designs produce qualitative data. Exploratory designs do not usually produce 
quantitative data, which represent phenomena by assigning numbers in an ordered and meaningful 
way. Rather than numbers, the focus of qualitative research is on stories, visual portrayals, meaningful 
characterizations, interpretations, and other expressive descriptions. Often, exploratory research may 
companies that reported higher . é PPA 
be needed to develop the ideas that lead to research hypotheses. In other words, in some situations 
sales and revenue for the fourth h Fexpl hi bl hh hesi nfi hth 
quarter of 2008. the outcome of exploratory research is a testable research hypothesis. Confirmatory research then tests 
these hypotheses with quantitative data. The results of these tests 
help decision making by suggesting a specific course of action. 


suited for drawing definitive conclusions, as would be expected from causal designs involving experi- 


NetFlix is one of the few 


ASK) 


For example, an exploratory researcher is more likely 
to adopt a qualitative approach that might involve trying to 


Saar a develop a deeper understanding of how families are impacted by 


How it Work 


Rent as many movi 


"Free Tal Taig : : PE . ae 
changing economic conditions, investigating how people suffer- 


es as you want! torfem ing economically spend scarce resources. This may lead to the 
= development of a hypothesis that during challenging economic 
times consumers seek low-cost entertainment such as movie 
rentals, but would not test this hypothesis. In contrast, a quanti- 
tative researcher may search for numbers that indicate economic 
trends. This may lead to hypothesis tests concerning how much 


the economy influences rental movie consumption. 
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Some types of qualitative studies can be conducted very quickly. Others take a very long TO POINT 
time. For example, a single focus group analysis involving a large bottling company’s sales force 
can likely be conducted and interpreted in a matter of days. This would provide faster results The cure for | 
than most descriptive or causal designs. However, other types of qualitative research, such as a 
participant-observer study aimed at understanding skateboarding, could take months to complete. 
A qualitative approach can, but does not necessarily, save time. CEOE CITGO) 

In summary, when researchers have limited experience or knowledge about a research issue, —Dorothy Parker 
exploratory research is a useful step. Exploratory research, which often involves qualitative meth- 
ods, can be an essential first step to a more conclusive, confirmatory study by reducing the chance 
of beginning with an inadequate, incorrect, or misleading set of research objectives. 


Orientations to Qualitative Research 


Qualitative research can be performed in many ways using many techniques. Orientations to 
qualitative research are very much influenced by the different fields of study involved in research. 
These orientations are each associated with a category of qualitative research. The major categories 
of qualitative research include 


Phenomenology—originating in philosophy and psychology 
Ethnography—originating in anthropology 
Grounded theory—originating in sociology 


BONS 


Case studies—originating in psychology and in business research 


Precise lines between these approaches are difficult to draw and there are clearly links among 
these orientations. In addition, a particular qualitative research study may involve elements of two 
or more approaches. However, each category does reflect a somewhat unique approach to human 
inquiry and approaches to discovering knowledge. Each will be described briefly below. 


Phenomenology 


WHAT IS A PHENOMENOLOGICAL APPROACH TO RESEARCH? 


Phenomenology represents a philosophical approach to studying human experiences based on the phenomenology 


idea that human experience itself is inherently subjective and determined by the context in which A philosophical approach to 
people live." 
by the relationship he or she has with the physical environment, objects, people, and situations. 


The phenomenological researcher focuses on how a person’s behavior is shaped studying human experiences 
based on the idea that human 


experience itself is inherently 


: : i . : : : subjective and determined by 
Researchers with a phenomenological orientation rely largely on conversational interview the context in which people live. 


Phenomenological inquiry seeks to describe, reflect upon, and interpret experiences. 


tools. When conversational interviews are face to face, they are recorded either with video or 
audiotape and then interpreted by the researcher. The phenomenological interviewer is careful to 
avoid asking direct questions when at all possible. Instead, the research respondent is asked to tell 
a story about some experience. In addition, the researcher must do everything possible to make 
sure a respondent is comfortable telling his or her story. One way to accomplish this is to become 
a member of the group (for example, becoming a skateboarder in the scenario described earlier 
in this chapter). Another way may be to avoid having the person use his or her real name. This 
might be particularly necessary in studying potentially sensitive topics such as smoking, drug usage, 
shoplifting, or employee theft. 

Therefore, a phenomenological approach to studying the meaning of Vans may require con- 
siderable time. The researcher may first spend weeks or months fitting in with the person or 
group of interest to establish a comfort level. During this time, careful notes of conversations are 
made. If an interview is sought, the researcher would likely not begin by asking a skateboarder to 
describe his or her shoes. Rather, asking for favorite skateboard incidents or talking about what 
makes a skateboarder unique may generate productive conversation. Generally, the approach is 
very unstructured as a way of avoiding leading questions and to provide every opportunity for 
new insights. 
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“When Will | Ever Learn?” 
A hermeneutic approach can be used to provide insight into car 
shopping experiences. The approach involves a small number of 
consumers providing relatively lengthy stories about recent car 
shopping experiences. The goal is trying to discover particular 
reasons why certain car models are eliminated from consider- 
ation. The consumer tells a story of comparing a Ford anda GM 
(General Motors) minivan. She describes the two vehicles in great 
detail and ultimately concludes, “We might have gone with the 
Ford instead because it was real close between the Ford and the 
GM."The Ford was cheaper, but the way the door opened sug- 
gested difficulties in dealing with kids and groceries and the like, 
and so she purchased the GM model. The researcher in this story 
goes on to interpret the plotline of the story as having to do with 
her responsibility for poor consumption outcomes. Consider the 
following passage. 

“It has got GM defects and 
that is really frustrating. | mean 
the transmission had to be 


and it had this horrible vibration problem. We 
took a long vacation where you couldn't go over 
sixty miles an hour because the thing started 
shaking so bad... . I told everybody, ‘Don’t buy 
one of these things.’ We should have known 
because our Buick—the Buick that is in the shop 
right now—its transmission lasted about 3,000 miles. My husband's 
parents are GM people and they had one go bad. I keep thinking, 

When I am going to learn? I think this one has done it. | don’t think I will 
ever go back to GM after this.” 

The research concludes that a hermeneutic link exists between 
the phrase “When | am going to learn?” and the plot of self- 
responsibility. The resulting behavior including no longer consid- 
ering GM products and the negative word-of-mouth behavior are 
ways of restoring esteem given the events. 

Source: Journal of Marketing Research by Winer, Russ. Copyright 1997 by American 
Marketing Association (AMA) (CHIC). Reproduced with permission of American Market- 
ing Association (AMA) (CHIC) in the format Textbook via Copyright Clearance Center; 


Thompson, Craig J., “Interpreting Consumers: A Hermeneutical Framework for Deriv- 
ing Marketing Insights from the Tests of Consumers’ Consumption Stories,” Journal of 


rebuilt after about 150 miles... Marketing Research, 34 (November 1997), 438-455 (see pp. 443-444 for quotation). 


hermeneutics 


An approach to understanding 
phenomenology that relies on 
analysis of texts through which 
a person tells a story about him 
or herself. 


hermeneutic unit 


Refers to a text passage from a 
respondent's story that is linked 
with a key theme from within 
this story or provided by the 
researcher. 


ethnography 


Represents ways of studying 
cultures through methods that 
involve becoming highly active 

within that culture. 


participant-observation 


Ethnographic research approach 
where the researcher becomes 
immersed within the culture that 
he or she is studying and draws 
data from his or her observations. 
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WHAT IS HERMENEUTICS? 


The term hermeneutics is important in phenomenology. Hermeneutics is an approach to under- 
standing phenomenology that relies on analysis of texts in which a person tells a story about him 
or herself.'? Meaning is then drawn by connecting text passages to one another or to themes 
expressed outside the story. These connections are usually facilitated by coding the key meanings 
expressed in the story. While a full understanding of hermeneutics is beyond the scope of this 
text, some of the terminology is used when applying qualitative tools. For instance, a hermeneutic 
unit refers to a text passage from a respondent’s story that is linked with a key theme from within 
this story or provided by the researcher." These passages are an important way in which data are 
interpreted. 

Computerized software exists to assist in coding and interpreting texts and images. ATLAS.ti 
is one such software package that adopts the term hermeneutic unit in referring to groups of phrases 
that are linked with meaning. Hermeneutic units and computerized software are also very appropri- 
ate in grounded theory approaches. One useful component of computerized approaches is a word 
counter. The word counter will return counts of how many times words were used in a story. 
Often, frequently occurring words suggest a key theme. The Research Snapshot above demon- 
strates the use of hermeneutics in interpreting a story about a consumer shopping for a car. 


Ethnography 
WHAT IS ETHNOGRAPHY? 


Ethnography represents ways of studying cultures through methods that involve becoming highly active 
within that culture. Participant-observation typifies an ethnographic research approach. Participant- 
observation means the researcher becomes immersed within the culture that he or she is studying and 
draws data from his or her observations. A culture can be either a broad culture, like American culture, 
or a narrow culture, like urban gangs, Harley-Davidson owners, or skateboarding enthusiasts." 
Organizational culture would also be relevant for ethnographic study. At times, researchers 
have actually become employees of an organization for an extended period of time. In doing so, they 
become part of the culture and over time other employees come to act quite naturally around the 
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researcher. The researcher 
may observe behaviors that 
the employee would never 
reveal otherwise. For instance, 
a researcher investigating the 
ethical behavior of salespeople 
may have difficulty getting a 
car salesperson to reveal any 
potentially deceptive sales tac- 
tics in a traditional interview. 
However, ethnographic tech- 
niques may result in the sales- 
person letting down his or her 
guard, resulting in more valid 
discoveries about the car- 
selling culture. 


E OBSERVATION IN 
ETHNOGRAPHY 


Observation plays a key role 
in ethnography. Researchers 
today sometimes ask house- 
holds for permission to place 
video cameras in their home. 
In doing so, the ethnogra- 
pher can study the consumer in a “natural habitat” and use the observations to test new products, 
develop new product ideas, and develop strategies in general.'° 

Ethnographic study can be particularly useful when a certain culture is comprised of individu- 
als who cannot or will not verbalize their thoughts and feelings. For instance, ethnography has 
advantages for discovering insights among children since it does not rely largely on their answers 
to questions. Instead, the researcher can simply become part of the environment, allow the chil- 
dren to do what they do naturally, and record their behavior." 

The opening vignette describing a participant-observer approach to learning about skate- 
boarding culture represents an ethnographic approach. Here, the researcher would draw insight 
from observations and personal experiences with the culture. 


Grounded Theory 
| WHAT IS GROUNDED THEORY? 


Grounded theory is probably applied less often in business research than is either phenomenology 
or ethnography." 

Grounded theory represents an inductive investigation in which the researcher poses questions 
about information provided by respondents or taken from historical records. The researcher asks 
the questions to him or herself and repeatedly questions the responses to derive deeper explanations. 
Grounded theory is particularly applicable in highly dynamic situations involving rapid and significant 
change. Two key questions asked by the grounded theory researcher are “What is happening here?” 
and “How is it different?” The distinguishing characteristic of grounded theory is that it does not 
begin with a theory but instead extracts one from whatever emerges from an area of inquiry.” 


HOW IS GROUNDED THEORY USED? 


Consider a company that approaches a researcher to study whether or not its sales force is as 
effective as it has been over the past five years. The researcher uses grounded theory to discover 
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Ethnographic (participant- 
observation) approaches may 
be useful to understanding how 
children obtain value from their 
experiences with toys. 


I never predict. I just 
look out the window 


and see what is 
visible—but not yet 
seen. 


— Peter Drucker 


grounded theory 


Represents an inductive investi- 
gation in which the researcher 
poses questions about informa- 
tion provided by respondents 

or taken from historical records; 
the researcher asks the questions 
to him or herself and repeatedly 
questions the responses to derive 
deeper explanations. 
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Qualitative research reveals 
that products that are 
perceived as “authentic” offer 
more value for consumers. 


case studies 


The documented history 
of a particular person, group, 
organization, or event. 


themes 


Identified by the frequency 
with which the same term 
(or a synonym) arises in the 

narrative description. 


Part 2: Beginning Stages of the Research Process 


a potential explanation. A theory is inductively developed 
based on text analysis of dozens of sales meetings that had been 
recorded over the previous five years. By questioning the events 
discussed in the sales interviews and analyzing differences in the 
situations that may have led to the discussion, the researcher 
is able to develop a theory. The theory suggests that with an 
increasing reliance on e-mail and other technological devices 
for communication, the salespeople do not communicate with 
each other informally as much as they did five years previously. 
As a result, the salespeople had failed to bond into a close-knit 
“community.””! 

Computerized software also can be useful in developing 
grounded theory. In our Vans example, the researcher may 
interpret skateboarders’ stories of good and bad skating experi- 
ences by questioning the events and changes described. These 
may yield theories about the role that certain brands play in 
shaping a good or bad experience. Alternatively, grounded the- 
orists often rely on visual representations. Thus, the skateboarder 
could develop collages representing good and bad experiences. 
Just as with the text, questions can be applied to the visuals in an 
effort to develop theory. 


Case Studies 


WHAT ARE CASE STUDIES? 


Case studies simply refer to the documented history of a par- 
ticular person, group, organization, or event. Typically, a case 
study may describe the events of a specific company as it faces 
an important decision or situation, such as introducing a new 
product or dealing with some management crisis. Textbook cases 
typify this kind of case study. Clinical interviews of managers, employees, or customers can repre- 
sent a case study. 

The case studies can then be analyzed for important themes. Themes are identified by the fre- 
quency with which the same term (or a synonym) arises in the narrative description. The themes 
may be useful in discovering variables that are relevant to potential explanations. 


HOW ARE CASE STUDIES USED? 


Case studies are commonly applied in business. For instance, case studies of brands that sell “lux- 
ury” products helped provide insight into what makes up a prestigious brand. A business researcher 
carefully conducted case (no pun intended) studies of higher end wine labels (such as Penfold’s 
Grange) including the methods of production and distribution. This analysis suggested that a key 
ingredient to a prestige brand may well be authenticity. When consumers know something is 
authentic, they attach more esteem to that product or brand.” 

Case studies often overlap with one of the other categories of qualitative research. The 
Research Snapshot on the next page illustrates how observation was useful in discovering insights 
leading to important business changes. 

A primary advantage of the case study is that an entire organization or entity can be inves- 
tigated in depth with meticulous attention to detail. This highly focused attention enables the 
researcher to carefully study the order of events as they occur or to concentrate on identify- 
ing the relationships among functions, individuals, or entities. Conducting a case study often 
requires the cooperation of the party whose history is being studied. This freedom to search 
for whatever data an investigator deems important makes the success of any case study highly 
dependent on the alertness, creativity, intelligence, and motivation of the individual performing 
the case analysis. 
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{It’s Like Riding a Bike! 
Schwinn has long relied on obser- 
vational research in their exploratory 
research studies. Here is a description of a case 


study documented from observational techniques: 


We had a very successful dealer on the West Coast. So it 

occurred to me that we'd go out and find out how he’s doing it. 

So we go out. The guy’s got a nice store out in Van Nuys. We sit in 
the back room and we listen. The first customers come in, aman 
and a woman with a boy about nine or ten years old. The dad says, 
“Which one is it?” The son says, “This one over here.” Dad looks at it. 
He says to the clerk, “How much is it?” The clerk says, “$179.95.” The 
father says, “Okay, we'll take it.” It blew the whole bit [there were 
no magic sales approaches]. Suddenly it dawned on us that it’s not 
what they say, it’s the atmosphere of the store. Here was not Joe’s 
old, dirty bike shop—it was a beautiful store on the main street. 

A big sign was in front, “Valley Cyclery,” inside [were] fluorescent 
lights, carpeting on the floor, stereo music, air-conditioning, and a 
beautiful display of bicycles. It was like a magnet. People came in. 
So, we've tried to introduce that idea to other dealers. Put a bigger 


investment into your store and see what happens. Some of them 
did, and it happened [sales improved]. 


More recently, researchers documented with photographs 
the way that most people use their bicycles. Although the vast 
majority of bikes available for sale are multispeed racing or 
mountain bikes, even a cursory observation of the photos sug- 
gested that most people clearly do not race on their bikes nor 
use them off-road. As a result, Schwinn reintroduced the Cruiser 
with much success. The Cruiser is the 1950ish touring bike with 
the balloon tires, big cushioned seat, and upright handlebars. In 
fact, the Cruiser series proved to be so successful that over 20 
different 2009 Cruiser models were produced. Observation is like 
riding a bike—once you learn, you shouldn't ever forget! 

Sources: Burch, Ray (1973), “Marketing Research: Why It Works, Why It Doesn't Work,” 
speech to the Chicago Chapter of the American Marketing Association, 1973, reprinted 
with permission of the Chicago Chapter of 
the American Marketing Association; Curry, A. 
and M. Silver, “One Speed Is Enough,” 

U.S. News and World Report 136 (May 10, 
2004), 67-68. A complete list of the models 


is available at http://www.schwinnbike. 
com/usa/eng/Products/Cruisers/. 


Common Techniques Used in 
Qualitative Research 


Qualitative researchers apply a nearly endless number of techniques. These techniques overlap 
more than one of the orientations previously discussed, although each category may display a pref- 
erence for certain techniques. Exhibit 7.2 on the next page lists characteristics of some common 
qualitative research techniques. Each is then described. 


What Is a Focus Group Interview? 


The focus group interview is so widely used that many advertising and research agencies do noth- 
ing but focus group interviews. In that sense, it is wrongly synonymous with qualitative research. 
Nonetheless, focus groups are a very important qualitative research technique and deserve con- 
siderable discussion. 

A focus group interview is an unstructured, free-flowing interview with a small group of 
people, usually between six and ten. Focus groups are led by a trained moderator who follows a 
flexible format encouraging dialogue among respondents. Common focus group topics include 
employee programs, employee satisfaction, brand meanings, problems with products, advertising 
themes, or new-product concepts. 

The group meets at a central location at a designated time. Participants may range from 
consumers talking about hair coloring, petroleum engineers talking about problems in the “oil 
patch,” children talking about toys, or employees talking about their jobs. A moderator begins by 
providing some opening statement to broadly steer discussion in the intended direction. Ideally, 
discussion topics emerge at the group’s initiative, not the moderator’s. Consistent with phenom- 
enological approaches, moderators should avoid direct questioning unless absolutely necessary. 


ADVANTAGES OF FOCUS GROUP INTERVIEWS 


Focus groups allow people to discuss their true feelings, anxieties, and frustrations, as well as the 
depth of their convictions, in their own words. While other approaches may also do much the 
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focus group interview 


An unstructured, free-flowing 
interview with a small group of 
around six to ten people. Focus 
groups are led by a trained 
moderator who follows a flexible 
format encouraging dialogue 
among respondents. 
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Four Common Qualitative Research Tools 


Type of Approach 


Description (Category) 


Key Advantages 


Key Disadvantages 


Focus Group 
Interviews 


Depth Interviews 


Conversations 


Semi-Structured 
Interviews 


Word Association/ 
Sentence Completion 


Observation 


Collages 


Thematic Apperception/ 
Cartoon Tests 


Small group discussions 
led by a trained moderator 


One-on-one, probing 
interview between a 
trained researcher anda 
respondent 


Unstructured dialogue 
recorded by a researcher 


Open-ended questions, 
often in writing, that ask 
for short essay-type 
answers from respondents 


Records the first thoughts 
that come to a consumer in 
response to some stimulus 


Recorded notes describing 
observed events 


Respondent assembles 
pictures that represent 
their thoughts/feelings 


Researcher provides an 
ambiguous picture and 
respondent tells about the 
story 


same, focus groups offer several advantages: 


Relatively fast 
Easy to execute 


ie eer oak a 


Ethnography, case 
studies 


Ethnography, 
grounded theory, 
case studies 


Phenomenology, 
grounded theory 


Grounded theory, 
ethnography 


Grounded theory, 
case studies 


Ethnography, 
grounded theory, 
case studies 


Phenomenology, 
grounded theory 


Phenomenology, 
grounded theory 


Provide multiple perspectives 


6. High degree of scrutiny 


Speed and Ease 


In an emergency situation, three or four group sessions can be conducted, analyzed, and reported 


Can be done quickly 
Gain multiple 
perspectives 
Flexibility 


Gain considerable 
insight from each 
individual 

Good for understanding 
unusual behaviors 


Gain unique insights 
from enthusiasts 

Can cover sensitive topics 
Less expensive than 
depth interviews or focus 
groups 


Can address more 
specific issues 
Results can be easily 
interpreted 

Cost advantages over 
focus groups and 
depth interviews 


Economical 
Can be done quickly 


Can be unobtrusive 
Can yield actual behavior 
patterns 


Flexible enough to 
allow novel insights 


Projective, allows to get 
at sensitive issues 
Flexible 


Allow respondents to piggyback off each other’s ideas 


Flexibility to allow more detailed descriptions 


Results dependent on 
moderator 

Results do not generalize 
to larger population 
Difficult to use for 
sensitive topics 
Expensive 


Result dependent on 
researcher's interpretation 
Results not meant 

to generalize 

Very expensive 


Easy to get off course 
Interpretations are very 
researcher-dependent 


Lack the flexibility that 
is likely to produce 
truly creative or novel 
explanations 


Lack the flexibility that 
is likely to produce 
truly creative or novel 
explanations 


Can be very expensive 
with participant-observer 
series 


Highly dependent 
on the researcher's 
interpretation of the 
collage 


Highly dependent 
on the researcher's 
interpretation 


in a week or so. The large number of research firms that conduct focus group interviews makes it 


easy to find someone to host and conduct the research. Practically every state in the United States 
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contains multiple research 
firms that have their own 
focus group facilities. Com- 
panies with large research 
departments likely have at 
least one qualified focus 
group moderator so that 
they need not outsource 
the focus group. 


Piggybacking 
and Multiple 

Perspectives 

Furthermore, the group 
approach may produce 
thoughts that would not 
be produced otherwise. 
The 
respondents allows them to 
piggyback off of each oth- 
er’s ideas. In other words, 


interplay between 


one respondent stimulates 

thought among the others and, as this process continues, increasingly creative insights are pos- 
sible. A comment by one individual often triggers a chain of responses from the other participants. 
The social nature of the focus group also helps bring out multiple views as each person shares a 
particular perspective. 


Flexibility 

The flexibility of focus group interviews is advantageous, especially when compared with the 
more structured and rigid survey format. Numerous topics can be discussed and many insights can 
be gained, particularly with regard to the variations in consumer behavior in different situations. 
Responses that would be unlikely to emerge in a survey often come out in group interviews: 
“Tf the day is hot and I have to serve the whole neighborhood, I make Kool-Aid; otherwise, I 
give them Dr Pepper or Coke” or “Usually I work on my projects at home in the evenings, but 
when it is a team project we set aside time on Monday morning and all meet in the conference 
room.” 

If a researcher is investigating a target group to determine who consumes a particular bev- 
erage or why a consumer purchases a certain brand, situational factors must be included in any 
interpretations of respondent comments. For instance, in the preceding situation, the fact that a 
particular beverage is consumed must be noted. It would be inappropriate to say that Kool-Aid 
is preferred in general. The proper interpretation is situation specific. On a hot day the whole 
neighborhood gets Kool-Aid. When the weather isn’t hot, the kids may get nothing, or if only a 
few kids are around, they may get lucky and get Dr Pepper. Thus, Kool-Aid can be interpreted 
as appropriate for satisfying large numbers of hot kids while Dr Pepper is a treat for a select few. 
Similarly, individual assignments are worked on at home in the evenings, while team projects are 
in the morning in the conference room. 


Scrutiny 

A focus group interview allows closer scrutiny in several ways. First, the session can be observed 
by several people, as it is usually conducted in a room containing a two-way mirror. The respon- 
dents and moderator are on one side, and an invited audience that may include both researchers 
and decision makers is on the other. If the decision makers are located in another city or country, 
the session may be shown via a live video hookup. Either through live video or a two-way mirror, 
some check on the eventual interpretations is provided through the ability to actually watch the 
research being conducted. If the observers have questions that are not being asked or want the mod- 
erator to probe on an issue, they can send a quick text message with instructions to the moderator. 
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Focus group facilities typically 
include a comfortable room 
for respondents, recording 
equipment, and a viewing 
room via a two-way mirror. 


piggyback 

A procedure in which one 
respondent stimulates thought 
among the others; as this process 
continues, increasingly creative 
insights are possible. 
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Imagine the differences in 
reactions to legislation further 
restricting smoking behavior 
that would be found among a 
group of smokers compared to 
a group of nonsmokers. 
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Second, focus group sessions are generally recorded on audio or videotape. Later, detailed exami- 
nation of the recorded session can offer additional insight and help clear up disagreements about 
what happened. 


FOCUS GROUP ILLUSTRATION 


Focus groups often are used for concept screening and concept refinement. The concept may 
be continually modified, refined, and retested until management believes it is acceptable. While 
RJR’s initial attempts at smokeless cigarettes failed in the United States, Philip Morris is develop- 
ing a smokeless cigarette for the U.K. market. Focus groups are being used to help understand 
how the product will be received and how it might be improved.” The voluntary focus group 
respondents are presented with samples of the product and then they discuss it among themselves. 
The interview results suggest that the key product features that must be conveyed are the fact that 
it produces no ashes, no side smoke, and very little odor. These beliefs are expected to lead to a 
positive attitude. Focus group respondents show little concern about how the cigarette actually 
functioned. Smokers believe they will use the product if nonsmokers are not irritated by being 
near someone using the “electronic cigarette.” Thus, the focus groups are useful in refining the 
product and developing a theory of how it should be marketed. 


GROUP COMPOSITION 


The ideal size of the focus group is six to ten people. If the group is too small, one or two members 
may intimidate the others. Groups that are too large may not allow for adequate participation by 
each group member. 

Homogeneous groups seem to work best because they allow researchers to concentrate on con- 
sumers with similar lifestyles, experiences, and communication skills. The session does not become 
rife with too many arguments and different viewpoints stemming from diverse backgrounds. Also, 
from an ethnographic perspective, the respondents should all be members of a unique and identifi- 
able culture. Vans may benefit from a focus group interview comprised only of skateboard enthusi- 
asts. Perhaps participants can be recruited from a local skate park. However, additional group(s) of 
participants that are not boarders might be useful in gaining a different perspective. 

When the Centers for Disease Control and Prevention tested public service announcements about 
AIDS through focus groups, it discovered that single-race groups and racially diverse groups reacted dif- 
ferently. By conducting separate 
focus groups, the organization 
was able to gain important insights 
about which creative strategies 
were most appropriate for tar- 
geted versus broad audiences. 

For example, for focus 
groups regarding employee sat- 
isfaction, we might want to 
recruit homogeneous groups 
based on position in the organi- 
zation. The researcher may find 
that entry-level employees have 
very different perspectives and 
concerns than those of middle or 
upper-level management. Also, 
it is fully understandable that 
employees might be hesitant to 
criticize their supervisors. There- 
fore, researchers may consider 
interviewing different levels of 
employees in separate groups. 
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A Overworked and Overpaid? 
* Ethical Issues in Choosing 
Focus Group Respondents 

Focus groups are one of the most sought-after 
services provided by research firms. What is a 
research supplier's responsibility when recruiting individuals to 
participate in a focus group? Practically every focus group inter- 
view requires that respondents be selected based on some rel- 
evant characteristic. For example, if the topic involves parochial 
school education, the group should probably not include non- 
parents or nonparents with no plans of having children or ever 
putting a child through school. Consumers that fit the desired 
profile sometimes make poor focus group participants. When a 
researcher finds good focus group participants, he or she may 
be tempted to use them over and over again. Is this appropriate? 
Should respondents be recruited because they will freely offer 
a lot of discussion without being overbearing or because they 
have the desired characteristics given the focus group topic? This 
is a question the focus group planner may well face. 

For example, a research client observed a focus group inter- 
view being conducted by a research supplier that had previously 


performed several other projects for the client, each dealing with 
a quite unique topic. During the interview, the client noticed that 
some focus group respondents looked familiar. 

A few days later, the client reviewed video recordings of the 
session alongside videotapes from two previous focus groups 
outsourced to the same company. She found that eight of the 
ten respondents in the latest focus group had appeared in one of 
the previous interviews as well. She was furious and considered 
whether or not she should pay for the interview or bother having 
a report prepared. 

The focus group researcher had taken this approach to make 
sure the session went smoothly. The moderator solicited sub- 
jects who in the past had been found to be very articulate and 
talkative. In this case, the focus group respondents are more or 
less “professional,” paid participants. It is questionable whether 
such “professional respondents” can possibly offer relevant 
opinions on all these topics. 
The question is, has the 
research firm acted in an ethi- 
cal manner? 
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Researchers who wish to collect information from different types of people should conduct 


several focus groups. A diverse overall sample may be obtained by using different groups even 


though each group is homogeneous. For instance, in discussing household chores, four groups 


might be used: 


e Married men 

e Married women 
¢ Single men 

e Single women 


Although each group is homogeneous, by using four groups, researchers obtain opinions from 


a wide degree of respondents. 


ENVIRONMENTAL CONDITIONS 


A focus group session may typically take place at the research agency in a room specifically designed 


for this purpose. Research suppliers that specialize in conducting focus groups operate from com- 


mercial facilities that have videotape cameras in observation rooms behind two-way mirrors and 


microphone systems connected to tape recorders and speakers to allow greater scrutiny as dis- 


cussed above. Refreshments are provided to help create a more relaxed atmosphere conducive to 


a free exchange of ideas. More open and intimate reports of personal experiences and sentiments 


can be obtained under these conditions. 


THE FOCUS GROUP MODERATOR 


The moderator essentially runs the focus group and plays a critical role in its success. There are 


several qualities that a good moderator must possess: 


1. The moderator must be able to develop rapport with the group to promote interaction among 
all participants. The moderator should be someone who is really interested in people, who 


moderator 


A person who leads a focus 

group interview and ensures that 
everyone gets a chance to speak 
and contribute to the discussion. 
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discussion guide 


A focus group outline that 
includes written introductory 
comments informing the group 
about the focus group purpose 
and rules and then outlines top- 
ics or questions to be addressed 
in the group session. 
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listens carefully to what others have to say, and who can readily establish rapport, gain people’s 
confidence, and make them feel relaxed and eager to talk. 


N 


The moderator must be a good listener. Careful listening is especially important because the 
group interview’s purpose is to stimulate spontaneous responses. Without good listening skills, 
the moderator may direct the group in an unproductive direction. 

3. The moderator must try not to interject his or her own opinions. Good moderators usually say 
less rather than more. They can stimulate productive discussion with generalized follow-ups 
such as, “Tell us more about that incident,” or “How are your experiences similar or different 
from the one you just heard?” The moderator must be particularly careful not to ask leading 
questions such as “You are happy to work at Acme, aren’t you?” 

4. The moderator must be able to control discussion without being overbearing. The mod- 
erator’s role is also to focus the discussion on the areas of concern. When a topic is no 
longer generating fresh ideas, the effective moderator changes the flow of discussion. The 
moderator does not give the group total control of the discussion, but he or she normally 
has prepared questions on topics that concern management. However, the timing of these 
questions in the discussion and the manner in which they are raised are left to the mod- 
erator’s discretion. The term focus group thus stems from the moderator’s task. He or she 
starts out by asking for a general discussion but usually focuses in on specific topics during 
the session. 


PLANNING THE FOCUS GROUP OUTLINE 


Focus group researchers use a discussion guide to help control the interview and guide the dis- 
cussion into product areas. A discussion guide includes written introductory comments inform- 
ing the group about the focus group purpose and rules and then outlines topics or questions to 
be addressed in the group session. Thus, the discussion guide serves as the focus group outline. 
Some discussion guides will have only a few phrases in the entire document. Others may be more 
detailed. The amount of content depends on the nature and experience of the researcher and the 
complexity of the topic. 

A cancer center that wanted to warn the public about the effects of the sun used the discussion 
guide in Exhibit 7.3. The business researchers had several objectives for this question guide: 


e The first question was very general, asking that respondents describe their feelings about 
being out in the sun. This opening question aimed to elicit the full range of views within the 
group. Some individuals might view being out in the sun as a healthful practice, whereas oth- 
ers view the sun as deadly. The hope is that by exposing the full range of opinions, respon- 
dents would be motivated to fully explain their own position. This was the only question 
asked specifically of every respondent. Each respondent had to give an answer before free 
discussion began. In this way, individuals experience a nonthreatening environment encour- 
aging their free and full opinion. A general question seeking a reaction serves as an effective 
icebreaker. 

e The second question asks whether participants could think of any reason they should be 
warned about sunlight exposure. This question was simply designed to introduce the idea of 
a warning label. 

e Subsequent questions were asked and became increasingly specific. They were first asked 
about possible warning formats that might be effective. Respondents are allowed to react 
to any formats suggested by any other respondent. After this discussion, the moderator will 
introduce some specific formats the cancer center personnel have in mind. 

e Finally, the “bottom-line” question is asked: “What format would be most likely to induce 
people to take protective measures?” There would be probing follow-ups of each opinion so 
that a respondent couldn’t simply say something like “The second one.” All focus groups fin- 
ish up with a catchall question asking for any comments including any thoughts they wanted 
passed along to the sponsor (which in this case was only then revealed as the Houston-based 
cancer center). 


Researchers who planned the outline established certain objectives for each part of the focus 
group. The initial effort was to break the ice and establish rapport within the group. The logical 
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HIBIT 7.3 Discussion Guide for a Focus Group Interview 


Thank you very much for agreeing to help out with this research. We 
call this a focus group; let me explain how it works, and then please 
let me know if something isn’t clear. 

This is a discussion, as though you were sitting around just talking. 
You can disagree with each other, or just comment. We do ask that 
just one person talk at a time, because we tape-record the session 
to save me from having to take notes. Nothing you say will be 
associated with you or your church—this is just an easy way for us to 
get some people together. 

The subject is health risk warnings. Some of you may remember 
seeing a chart in a newspaper that gives a pollen count or a pollution 
count. And you've heard on the radio sometimes a hurricane watch 
or warning. You've seen warnings on cigarette packages or cigarette 
advertising, even if you don’t smoke. And today we're going to talk 
about warnings about the sun. Before we start, does anybody have a 
question? 


1. OK, let’s go around and talk about how often you spend time 
in the sun, and what you're likely to be doing. (FOR PARENTS): 
What about your kids—do you like them to be out in the sun? 

2. OK, can you think of any reason that somebody would give you 
a warning about exposure to the sun? 


(PROBE: IS ANY SUN EXPOSURE BAD, OR ONLY A CERTAIN DEGREE OF 
EXPOSURE, AND IF SO, WHAT IS IT? OR IS THE SUN GOOD FOR YOU?) 


3. What if we had a way to measure the rays of the sun that are 
associated with skin problems, so that you could find out which 
times of the day or which days are especially dangerous? How 
could, say, a radio station tell you that information in a way that 
would be useful? 

4. Now let me ask you about specific ways to measure danger. 
Suppose somebody said, “We monitored the sun’s rays at noon, 
and a typical fair-skinned person with unprotected skin will 
burn after 40 minutes of direct exposure.” What would 
you think? 
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. Now let me ask you about another way to say the same kind of 


thing. Suppose somebody said, “The sun’s rays at noon today 
measured 10 times the 8:00 a.m. baseline level of danger.” What 
would you think? 


. OK, now suppose that you heard the same degree of danger 


expressed this way: “The sun’s rays at noon today measured 
8 ona sun danger scale that ranges from one to ten.” What 
would you think? 


. What if the danger scale wasn’t in numbers, but words? 


Suppose you heard, “The sun’s rays at noon showed a 
moderate danger reading,” or “The sun’s rays showed a high 
danger reading.” What would you think? 


. And here’s another possibility: What if you heard “Here’s the 


sun danger reading at noon today—the unprotected skin of a 
typical fair-skinned person will age the equivalent of one hour 
in a ten-minute period.” 


. OK, what if somebody said today is a day to wear long sleeves 


and a hat, or today is a day you need sunscreen and long 
sleeves? What would you think? 


. OK, here’s my last question. There are really three things you 


can do about sun danger: You can spend less time in the sun, 
you can go out at less dangerous times of day, like before 10:00 
in the morning or after 4:00 in the afternoon, and you can cover 
your skin by wearing a hat or long sleeves, or using protective 
sunscreen lotion. Thinking about yourself listening to the radio, 
what kind of announcement would make you likely to do one 
or more of those things? (PARENTS: WHAT WOULD MAKE YOU 
BE SURE THAT YOUR CHILD WAS PROTECTED?) 


. And what would you be most likely to do to protect yourself? 


(YOUR CHILD?) 


. Before we break up, is there anything else you think would be 


useful for M. D. Anderson's people to know? Do you have any 
questions about any aspect of this interview? 


OK, thank you very much for your help. 


Gelb, Betsy D. and Michael P. Eriksen, “Market Research May Help Prevent Cancer,” Marketing Research (September 1991), 46. Published by American Marketing 


Association. Reprinted with permission. 


flow of the group session then moved from general discussion about sunbathing to more focused 


discussion of types of warnings about danger from sun exposure. 


In general, the following steps should be used to conduct an effective focus group discussion 


guide: 

1. Welcome and introductions should take place first. 

2. Begin the interview with a broad icebreaker that does not reveal too many specifics about the 
interview. Sometimes, this may even involve respondents providing some written story or 
their reaction to some stimulus like a photograph, film, product, or advertisement. 

3. Questions become increasingly more specific as the interview proceeds. However, the mod- 
erator will notice that a good interview will cover the specific question topics before they have 
to be asked. This is preferable as respondents are clearly not forced to react to the specific issue; 
it just emerges naturally. 

4. If there is a very specific objective to be accomplished, such as explaining why a respondent 
would either buy or not buy a product, that question should probably be saved for last. 

5: 


A debriefing statement should provide respondents with the actual focus group objectives and 


answering any questions they may have. This is also a final shot to gain some insight from the 


group. 
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online focus group 


A qualitative research effort in 
which a group of individuals 
provides unstructured comments 
by entering their remarks into an 
electronic Internet display board 
of some type. 


focus blog 


A type of informal, “continuous” 
focus group established as an 
Internet blog for the purpose of 
collecting qualitative data from 
participant comments. 


—William Wycherley 
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FOCUS GROUPS AS DIAGNOSTIC TOOLS 


Focus groups are perhaps the predominant means by which business researchers implement 
exploratory research designs. Focus groups also can be helpful in later stages of a research project, 
particularly when the findings from surveys or other quantitative techniques raise more questions 
than they answer. Managers who are puzzled about the meaning of survey research results may use 
focus groups to better understand what survey results indicate. In such a situation, the focus group 
supplies diagnostic help after quantitative research has been conducted. 

Focus groups are also excellent diagnostic tools for spotting problems with ideas. For instance, 
idea screening is often done with focus groups. An initial concept is presented to the group and 
then they are allowed to comment on it in detail. This usually leads to lengthy lists of potential 
product problems and some ideas for overcoming them. Mature products can also be “focus- 
grouped” in this manner. 


VIDEOCONFERENCING AND FOCUS GROUPS 


With the widespread utilization of videoconferencing, the number of companies using these 
systems to conduct focus groups has increased. With videoconference focus groups, manag- 
ers can stay home and watch on television rather than having to take a trip to a focus group 
facility. 

FocusVision (http://www.focusvision.com/) is a business research company that provides videocon- 
ferencing equipment and services. The FocusVision system is modular, allowing for easy move- 
ment and an ability to capture each group member close up. The system operates via a remote 
keypad that allows observers in a far-off location to pan the focus group room or zoom in on a 
particular participant. Managers viewing at remote locations can send the moderator messages 
during the interview. 


INTERACTIVE MEDIA AND ONLINE FOCUS GROUPS 


Internet applications of qualitative exploratory research are growing rapidly and involve both for- 
mal and informal applications. Formally, the term online focus group refers to a qualitative research 
effort in which a group of individuals provides unstructured comments by entering their remarks 
into an electronic Internet display board of some type, such as a chat-room session or in the form 
of a blog. Because respondents enter their comments into the computer, transcripts of verbatim 
responses are available immediately after the group session. Online groups can be quick and cost- 
efficient. However, because there is less personal interaction between participants, group synergy 
and snowballing of ideas may be diminished. 

Several companies have established a form of informal, “continuous” focus group by estab- 
lishing an Internet blog for that purpose.** We might call this technique a focus blog when the 
intention is to mine the site for business research purposes. General Motors, American Express, 
and Lego all have used ideas harvested from their focus blogs. When operating, the Lego blog can 
be found at http://legoisfun.blogspot.com. While traditional focus group respondents are generally paid 
$100 or more to show up and participate for 90 minutes, bloggers and online focus group respon- 
dents often participate for absolutely no fee at all! Thus, technology provides some cost advantages 
over traditional focus group approaches.” 


ONLINE VERSUS FACE-TO-FACE FOCUS GROUP TECHNIQUES 


A research company can facilitate a formal online focus group by setting up a private chat room 
for that purpose. Participants in formal and informal online focus groups feel that their anonym- 
ity is very secure. Often respondents will say things in this environment that they would never 
say otherwise. For example, a lingerie company was able to get insights into how it could design 
sexy products for larger women. Online, these women freely discussed what it would take “to 
One can hardly imagine how difficult such a discussion might be 
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feel better about being naked. 
face to face. Increased anonymity can be a major advantage for a company investigating sensitive 
or embarrassing issues. 
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Because participants do not have to be together in the same room at a research facility, the 
number of participants in online focus groups can be larger than in traditional focus groups. Twenty- 
five participants or more is not uncommon for the simultaneous chat-room format. Participants 
can be at widely separated locations since the Internet does not have geographical restrictions. 
Of course, a major disadvantage is that often the researcher does not exercise as much control in 
precisely who participates. In other words, a person could very easily not match the desired profile 
or even answer screening questions in a misleading way simply to participate. 

A major drawback with online focus groups is that moderators cannot see body language and 
facial expressions (bewilderment, excitement, boredom, interest, and so forth). Thus, they cannot 
fully interpret how people are reacting. Also, moderators’ ability to probe and ask additional ques- 
tions on the spot is reduced in online focus groups. Research that requires focus group members 
to actually touch something (such as a new easy-opening packaging design) or taste something is 
not generally suitable for an online format. 


DISADVANTAGES OF FOCUS GROUPS 


Focus groups offer many advantages as a form of qualitative research. Like practically every other 
research technique, the focus group has some limitations and disadvantages as well. Problems with 
focus groups include those discussed below. 

First, focus groups require objective, sensitive, and effective moderators. It is very difficult 
for a moderator to remain completely objective about most topics. In large research firms, the 
moderator may be provided only enough information to effectively conduct the interview, no 
more. The focus group interview obviously shouldn’t reduce to, or even be influenced by, the 
moderator’s opinion. Also, without a good moderator, one or two participants may dominate 
a session, yielding results that are really the opinion of one or two people, not the group. The 
moderator has to try very hard to make sure that all respondents feel comfortable giving their 
opinions and even a timid respondent’s opinion is given due consideration. While many peo- 
ple, even some with little or no background to do so, conduct focus groups, good moderators 
become effective through a combination of naturally good people skills, training (in qualitative 
research), and experience. 

Second, some unique sampling problems arise with focus groups. Researchers often select 
focus group participants because they have similar backgrounds and experiences or because 
screening indicates that the participants are more articulate or gregarious than the typical con- 
sumer (see the Research Snapshot on page 145). Such participants may not be representative 
of the entire target market. Thus, focus group results are not intended to be representative of a 
larger population. 

Third, although not so much an issue with online formats where respondents can remain 
anonymous, traditional face-to-face focus groups may not be useful for discussing sensitive topics. 
A focus group is a social setting and usually involves people with little to no familiarity with each 
other. Therefore, issues that people normally do not like to discuss in public may also prove dif- 
ficult to discuss in a focus group. 

Fourth, focus groups do cost a considerable amount of money, particularly when they are not 
conducted by someone employed by the company desiring the focus group. As research proj- 
ects go, there are many more expensive approaches, including a full-blown mail survey using a 
national random sample. This may cost thousands of dollars to conduct and thousands of dollars 
to analyze and disseminate. Focus group prices vary regionally, but the following figures provide 
a rough guideline: 


Renting facilities and equipment $500 
Recruiting of respondents ($75 person) $750 
Paying respondents ($100/person) $1,000 
Researcher costs 

e Preparation $750 

e Moderating $1,000 
e Analysis and report preparation $1,500 


Miscellaneous expenses $250 
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depth interview 


A one-on-one interview between 
a professional researcher and a 
research respondent conducted 
about some relevant business or 
social topic. 
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Thus, a client can expect a professional focus group to cost over $5,000 in most situations. 
Further, most business topics will call for multiple focus groups. There is some cost advantage 
in this, as some costs will not change proportionately just because there are multiple inter- 
views. Preparation costs may be the same for one or more interviews; the analysis and report 
preparation will likely only increase slightly because two or three interviews are included 
instead of one. 


Depth Interviews 


An alternative to a focus group is a depth interview. A depth interview is a one-on-one interview 
between a professional researcher and a research respondent. Depth interviews are much the same 
as a psychological, clinical interview, but with a different purpose. The researcher asks many ques- 
tions and follows up each answer with probes for additional elaboration. An excerpt from a depth 
interview is given in Exhibit 7.4. 


XHIBIT 7.4 Excerpt from a Depth Interview 


An interviewer (I) talks with Marsha (M) about furniture purchases. 
Marsha indirectly indicates she delegates the buying responsibility 


l: Do you feel that he’s a better judge than... 
M: Much better. 


to a trusted antique dealer. She has already said that she and her 

husband would write the dealer telling him the piece they wanted (e.g. 
bureau, table). The dealer would then locate a piece that he considered 
appropriate and would ship it to Marsha from his shop in another state. 


M: ...We never actually shopped for furniture since we state what 
we want and (the antique dealer) picks it out and sends it to us. So 
we never have to go looking through stores and shops and things. 

l: You depend on his (the antique dealer's) judgment? 

M: Uh, huh. And, uh, he happens to have the sort of taste that we like 
and he knows what our taste is and always finds something that 
we're happy with. 

l: You'd rather do that than do the shopping? 

M: Oh, much rather, because it saves so much time and it would be 

so confusing for me to go through stores and stores looking for 


I: Than you are? 

M: Yes, and that way | feel confident that what | have is very, very nice 
because he picked it out and | would be doubtful if | picked it out. 
| have confidence in him, (the antique dealer) knows everything 
about antiques, | think. If he tells me something, why | know it's 
true—no matter what | think. | know he is the one that's right. 


This excerpt is most revealing of the way in which Marsha could 
increase her feeling of confidence by relying on the judgment of 
another person, particularly a person she trusted. Marsha tells us 
quite plainly that she would be doubtful (i.e., uncertain) about her 
own judgment, but she “knows” (i.e., is certain) that the antique 
dealer is a good judge, “no matter what | think.” The dealer once 
sent a chair that, on first inspection, did not appeal to Marsha. She 
decided, however, that she must be wrong, and the dealer right, and 


things, looking for furniture. This is so easy that | just am very 


fortunate. 


grew to like the chair very much. 


From Cox, Donald F., Ed. Risk Taking and Information Handling in Consumer Behavior (Boston: Division of Research, Harvard Business School, © 1967), 65-66. 


Reprinted with permission. 


laddering 


A particular approach to probing, 
asking respondents to compare 
differences between brands at 
different levels that produces 
distinctions at the attribute level, 
the benefit level, and the value or 
motivation level. 


Like focus group moderators, the interviewer’s role is critical in a depth interview. He or 
she must be a highly skilled individual who can encourage the respondent to talk freely without 
influencing the direction of the conversation. Probing questions are critical. 

Laddering is a term used for a particular approach to probing, asking respondents to compare 
differences between brands at different levels. What usually results is that the first distinctions 
are attribute-level distinctions, the second are benefit-level distinctions, and the third are at the 
value or motivation level. Laddering can then distinguish two brands of skateboarding shoes 
based on a) the materials they are made of, b) the comfort they provide, and c) the excitement 
they create. 

Each depth interview may last more than an hour. Thus, it is a time-consuming process if 
multiple interviews are conducted. Not only does the interview have to be conducted, but each 
interview produces about the same amount of text as does a focus group interview. This has 
to be analyzed and interpreted by the researcher. A third major issue stems from the necessity 
of recording both surface reactions and subconscious motivations of the respondent. Analy- 
sis and interpretation of such data are highly subjective, and it is difficult to settle on a true 
interpretation. 
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Depth interviews provide more insight into a particular individual than do focus groups. In 
addition, since the setting isn’t really social, respondents are more likely to discuss sensitive topics 
than are those in a focus group. Depth interviews are particularly advantageous when some unique 
or unusual behavior is being studied. For instance, depth interviews have been usefully applied to 
reveal characteristics of adolescent behavior, ranging from the ways they get what they want from 
their parents to shopping, smoking, and shoplifting.” 

Depth interviews are similar to focus groups in many ways. The costs are similar if only a few 
interviews are conducted. However, if a dozen or more interviews are included in a report, the 
costs are higher than focus group interviews due to the increased interviewing and analysis time. 


Conversations 


Holding conversations in qualitative research is an informal data-gathering approach in which the 
researcher engages a respondent in a discussion of the relevant subject matter. This approach is 
almost completely unstructured and the researcher enters the conversation with few expectations. 
The goal is to have the respondent produce a dialogue about his or her lived experiences. Meaning 
will be extracted from the resulting dialogue. 

A conversational approach to qualitative research is particularly appropriate in phenomeno- 
logical research and for developing grounded theory. In our Vans experience, the researcher may 
simply tape-record a conversation about becoming a “skater.” The resulting dialogue can then 
be analyzed for themes and plots. The result may be some interesting and novel insight into the 
consumption patterns of skaters, for example, if the respondent said, 


“I knew I was a real skater when I just had to have Vans, not just for boarding, but for wearing.” 


This theme may connect to a right-of-passage plot and show how Vans play a role in this 
process. 

Technology is also influencing conversational research. Online communications such as the 
reviews posted about book purchases at http://www.barnesandnoble.com can be treated as a conversa- 
tion. Companies may discover product problems and ideas for overcoming them by analyzing 
these computer-based consumer dialogues.” 

A conversational approach is advantageous because each interview is usually inexpensive to 
conduct. Respondents often need not be paid. They are relatively effective at getting at sensitive 
issues once the researcher establishes a rapport with them. Conversational approaches, however, 
are prone to produce little relevant information since little effort is made to steer the conversation. 
Additionally, the data analysis is very much researcher-dependent. 


SEMI-STRUCTURED INTERVIEWS 


Semi-structured interviews usually come in written form and ask respondents for short essay 
responses to specific open-ended questions. Respondents are free to write as much or as little as 
they want. The questions would be divided into sections, typically, and within each section, the 
opening question would be followed by some probing questions. When these are performed face 
to face, there is room for less structured follow-ups. 

The advantages to this approach include an ability to address more specific issues. Responses 
are usually easier to interpret than other qualitative approaches. Since the researcher can simply 
prepare the questions in writing ahead of time, and if in writing, the questions are adminis- 
tered without the presence of an interviewer, semi-structured interviews can be relatively cost- 
effective. 

Some researchers interested in studying car salesperson stereotypes used qualitative semi- 
structured interviews to map consumers’ cognitions (memory). The semi-structured interview 
began with a free-association task: 


List the first five things that come into your mind when you think of a “car salesman.” 
This was followed up with a probing question: 


Describe the way a typical “car salesman” looks. 
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conversations 


An informal qualitative data- 
gathering approach in which the 
researcher engages a respondent 
in a discussion of the relevant 
subject matter. 
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free-association 
techniques 


Record respondents’ first (top- 
of-mind) cognitive reactions to 
some stimulus. 


field notes 


The researcher's descriptions of 
what actually happens in the 
field; these notes then become 
the text from which meaning is 
extracted. 
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This was followed with questions about how the car salesperson acts and how the respondent 
feels in the presence of a car salesperson. The results led to research showing how the informa- 
tion that consumers process differs in the presence of a typical car salesperson, as opposed to a less 
typical car salesperson.” 


SOCIAL NETWORKING 


Social networking is one of the most impactful trends in recent times. For many consumers, par- 
ticularly younger generations, social networking sites like MySpace, Second Life, Zebo, and oth- 
ers have become the primary tool for communicating with friends both far and near and known 
and unknown. Social networking has replaced large volumes of e-mail and, many would say, face— 
to-face communications as well. While the impact that social networking will eventually have on 
society is an interesting question, what is most relevant to marketing research is the large portion 
of this information that discusses marketing and consumer related information. 

Companies can assign research assistants to monitor these sites for information related to their 
particular brands. The information can be coded as either positive or negative. When too much 
negative information is being spread, the company can try to react to change the opinions. In 
addition, many companies like P&G and Ford maintain their own social networking sites for the 
purpose of gathering research data. In a way, these social networking sites are a way that compa- 
nies can eavesdrop on consumer conversations and discover key information about their products. 
The textual data that consumers willingly put up becomes like a conversation. When researchers 
get the opportunity to react with consumers or employees through a social network site, they can 
function much like an online focus group or interview. 


Free-Association/Sentence Completion Method 


Free-association techniques simply record a respondent’s first cognitive reactions (top-of-mind) to 
some stimulus. The Rorschach or inkblot test typifies the free-association method. Respondents 
view an ambiguous figure and are asked to say the first thing that comes to their mind. Free- 
association techniques allow researchers to map a respondent’s thoughts or memory. 

The sentence completion method is based on free-association principles. Respondents simply 
are required to complete a few partial sentences with the first word or phrase that comes to mind. 
For example: 


People who drink beer are 


A man who drinks a dark beer is 


Imported beer is most liked by 


The woman drinking beer in the commercial 


Answers to sentence-completion questions tend to be more extensive than responses to word- 
association tests. Although the responses lack the ability to probe for meaning as in other qualita- 
tive techniques, they are very effective in finding out what is on a respondent’s mind. They can 
also do so in a quick and very cost-effective manner. Free-association and sentence-completion 
tasks are sometimes used in conjunction with other approaches. For instance, they can sometimes 
be used as effective icebreakers in focus group interviews. 


OBSERVATION 


Observation can be a very important qualitative tool. The participant-observer approach typifies 
how observation can be used to explore various issues. Meaning is extracted from field notes. 
Field notes are the researchers’ descriptions of what actually happens in the field. These notes then 
become the text from which meaning is extracted. 

Observation may also take place in visual form. Researchers may observe employees in their 
workplace, consumers in their home, or try to gain knowledge from photographic records of one 
type or another. Observation can either be very inexpensive, such as when a research associate sits 
and simply observes behavior, or it can be very expensive, as in most participant-observer studies. 
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Observational research is keenly advantageous for gaining insight into things that respondents can- 
not or will not verbalize. Observation research is a common method of data collection and is the 
focus of a later chapter. 


COLLAGES 


Business researchers sometimes have respondents prepare a collage to represent their experiences. 
The collages are then analyzed for meaning much in the same manner as text dialogues are ana- 
lyzed. Computer software can even be applied to help develop potential grounded theories from 
the visual representations. 

Harley-Davidson commissioned research in which collages depicting feelings about Harley- 
Davidson were compared based on whether the respondent was a Harley owner or an owner of a 
competitor’s brand. The collages of “Hog” owners revealed themes of artwork and the freedom of 
the great outdoors. These themes did not emerge in the non-Hog groups. This led to confirma- 
tory research which helped Harley continue its growth, appealing more specifically to its diverse 
market segments.” 

Like sentence completion and word association, collages are often used within some other 
approach, such as a focus group or a depth interview. Collages offer the advantage of flexibility 
but are also very much subject to the researcher’s interpretations. 


PROJECTIVE RESEARCH TECHNIQUES 


A projective technique is an indirect means of questioning enabling respondents to project beliefs 
and feelings onto a third party, an inanimate object, or a task situation. Projective techniques usu- 
ally encourage respondents to describe a situation in their own words with little prompting by the 
interviewer. Individuals are expected to interpret the situation within the context of their own 
experiences, attitudes, and personalities and to express opinions and emotions that may be hid- 
den from others and possibly themselves. Projective techniques are particularly useful in studying 
sensitive issues. 

There is an old story about asking a man why he purchased a Mercedes-Benz. When asked 
directly why he purchased a Mercedes, he responds that the car holds its value and does not 
depreciate much, that it gets better gas mileage than you’d expect, or that it has a comfortable 
ride. If you ask the same person why a neighbor purchased a Mercedes, he may well answer, “Oh, 
that status seeker!” This story illustrates that individuals may be more likely to give true answers 
(consciously or unconsciously) to disguised questions, and a projective technique provides a way 
of disguising just who is being described. 


THEMATIC APPERCEPTION TEST (TAT) 


A thematic apperception test (TAT), sometimes called the picture interpretation technique, presents sub- 
jects with an ambiguous picture(s) and asks the subject to tell what is happening in the picture(s) 
now and what might happen next. Hence, themes (thematic) are elicited on the basis of the 
perceptual-interpretive (apperception) use of the pictures. The researcher then analyzes the contents 
of the stories that the subjects relate. A TAT represents a projective research technique. 

Frequently, the TAT consists of a series of pictures with some continuity so that stories may 
be constructed in a variety of settings. The first picture might portray a person working at their 
desk; in the second picture, a person that could be a supervisor is talking to the worker; the final 
picture might show the original employee and another having a discussion at the water cooler. 
A Vans TAT might include several ambiguous pictures of a skateboarder and then show him or 
her heading to the store. This might reveal ideas about the brands and products that fit the role 
of skateboarder. 

The picture or cartoon stimulus must be sufficiently interesting to encourage discussion but 
ambiguous enough not to disclose the nature of the research project. Clues should not be given 
to the character’s positive or negative predisposition. A pretest of a TAT investigating why men 
might purchase chainsaws used a picture of a man looking at a very large tree. The research 
respondents were homeowners and weekend woodcutters. They almost unanimously said that 
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projective technique 


An indirect means of questioning 
enabling respondents to project 
beliefs and feelings onto a third 
party, an inanimate object, or a 
task situation. 


thematic apperception 
test (TAT) 


A test that presents subjects with 
an ambiguous picture(s) in which 
consumers and products are the 
center of attention; the investiga- 
tor asks the subject to tell what is 
happening in the picture(s) now 
and what might happen next. 
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EXHIBIT 7.5 
An Example of a TAT Picture 


replication 


The same interpretation will be 
drawn if the study is repeated by 
different researchers with differ- 
ent respondents following the 
same methods. 


Part 2: Beginning Stages of the Research Process 


they would get professional help from a tree surgeon to deal with this situation. Thus, early in 
pretesting, the researchers found out that the picture was not sufficiently ambiguous. The tree 
was too large and did not allow respondents to identify with the tree-cutting task. If subjects are 
to project their own views into the situation, the environmental setting should be a well-defined, 
familiar problem, but the solution should be ambiguous. 

An example of a TAT using a cartoon drawing in which the respondent suggests a dialogue in 
which the characters might engage is provided in Exhibit 7.5. This TAT is a purposely ambigu- 
ous illustration of an everyday occurrence. The two office workers are shown in a situation and 
the respondent is asked what the woman might be talking about. This setting could be used for 
discussions about the organization’s management, store personnel, particular software products, 
and so on. 


Do you think 
we need to upgrade 
our word processing 
software? 


Exploratory Research in Science and in Practice 


Misuses of Exploratory and Qualitative Research 


Any research tool can be misapplied. Exploratory research cannot take the place of conclusive, 
confirmatory research. Thus, since many qualitative tools are best applied in exploratory design, 
they are likewise limited in the ability to draw conclusive inferences—test hypotheses. One of 
the biggest drawbacks is the subjectivity that comes along with “interpretation.” In fact, some- 
times the term interpretive research is used synonymously with qualitative research. When only 
one researcher interprets the meaning of what a single person said in a depth interview or similar 
technique, one should be very cautious before major business decisions are made based on these 
results. Is the result replicable? Replication means that the same results and conclusions will be 
drawn if the study is repeated by different researchers with different respondents following the same 
methods. In other words, would the same conclusion be reached based on another researcher’s 
interpretation? 


Chapter 7: Qualitative Research Tools 


Indeed, some qualitative research methodologies were generally frowned upon for years 
based on a few early and public misapplications during what became known as the “motiva- 
tional research” era. While many of the ideas produced during this time had some merit, as can 
sometimes be the case, too few researchers did too much interpretation of too few respondents. 
Compounding this, managers were quick to act on the results, believing that the results peaked 
inside one’s subliminal consciousness and therefore held some type of extra power. Thus, often 
the research was flawed based on poor interpretation, and the decision process was flawed because 
the deciders acted prematurely. As examples, projective techniques and depth interviews were 
frequently used in the late 1950s and early 1960s, producing some interesting and occasionally 
bizarre reasons for consumers’ purchasing behavior: 


e A woman is very serious when she bakes a cake because unconsciously she is going through 
the symbolic act of giving birth. 

e Aman buys a convertible as a substitute mistress and a safer (and potentially cheaper) way of 
committing adultery. 

e Men who wear suspenders are reacting to an unresolved castration complex.*! 


About two decades later, researchers for McCann-Erickson advertising agency interviewed low- 
income women using a form of TAT involving story completion regarding attitudes toward 
insecticides. Themes noted included: 


e The joy of victory over roaches (watching them die or seeing them dead) 
e Using the roach as a metaphor through which women can take out their hostility toward men 
(women generally referred to roaches as “he” instead of “she” in their stories).** 


Certainly, some useful findings resulted. Even today, we have the Pillsbury Doughboy as evidence 
that useful ideas were produced. In many of these cases, interpretations were either misleading or 
too ambitious (taken too far). However, many companies became frustrated when decisions based 
upon motivational research approaches proved poor. Thus, researchers moved away from qualita- 
tive tools during the late 1960s and 1970s. Today, however, qualitative tools have won acceptance 
once again as researchers realize they have greater power in discovering insights that would be 
difficult to capture in typical survey research (which is limited as an exploratory tool). 


SCIENTIFIC DECISION PROCESSES 


Objectivity and replicability are two characteristics of scientific inquiry. Are focus groups objective 
and replicable? Would three different researchers all interpret focus group data identically? How 
should a facial expression or nod of the head be interpreted? Have subjects fully grasped the idea 
or concept behind a nonexistent product? Have respondents overstated their satisfaction because 
they think their supervisor will read the report and recognize them from their comments? Many 
of these questions are reduced to a matter of opinion that may vary from researcher to researcher 
and from one respondent group to another. Therefore, a focus group, or a depth interview, or 
TAT alone does not best represent a complete scientific inquiry. 

However, if the thoughts discovered through these techniques survive preliminary evaluations 
and are developed into research hypotheses, they can be further tested. These tests may involve 
survey research or an experiment testing an idea very specifically (for example, ifa certain advertis- 
ing slogan is more effective than another). Thus, exploratory research approaches using qualitative 
research tools are very much a part of scientific inquiry. However, before making a scientific deci- 
sion, a research project should include a confirmatory study using objective tools and an adequate 
sample in terms of both size and how well it represents a population. 

But is a scientific decision approach always used or needed? In practice, many business decisions 
are based solely on the results of focus group interviews or some other exploratory result. The 
primary reasons for this are (1) time, (2) money, and (3) emotion. 


TIME 


Sometimes, researchers simply are not given enough time to follow up on exploratory research 
results. Companies feel an increasingly urgent need to get new products to the market faster. Thus, 
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A 
m 


z 
e Keep in mind two key differentiators between qualitative and œ Itis incorrect to conclude one type of S 

quantitative research: research is “better” than another, but 

e Qualitative research does not necessarily possess inter- certainly one type is more appropriate 
subjective certifiability. Two researchers can have the in a given set of circumstances. Qualitative 
same experience or observe the same phenomena and research tends to be well suited for exploratory 
have different interpretations. purposes, including clarifying the research 

e Wedo not have the ability to make statistical general- objective and identifying testable hypotheses. Qualitative 
izations from qualitative data. While numbers might research is often followed up by a quantitative study for con- 
appear—for example, we may observe that eight of the firmation. However, there are also instances when qualitative 
ten focus group participants mentioned the need for research follows a quantitative study for “sense making” and 
better on-the-job training—we cannot project this onto deeper insight into numerical results. 
the population (i.e., we cannot conclude 80 percent of all e Focus groups and depth interviews are the most common 
employees feel we need better on-the-job training). qualitative research techniques. 
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a seemingly good idea generated in a focus group (like Clear, Vanilla, or Cherry Dr Pepper) is 
simply not tested with a more conclusive study. The risk of delaying a decision may be seen as 
greater than the risk of proceeding without completing the scientific process. Thus, although the 
researcher may warn against it, there may be logical reasons for such action. The decision mak- 
ers should be aware, though, that the conclusions drawn from exploratory research designs are 
just that—exploratory. Thus, there is less likelihood of good results from the decision than if the 
research process had involved further testing. 


MONEY 


Similarly, researchers sometimes do not follow up on exploratory research results because they 
believe the cost is too high. Realize that tens of thousands of dollars may have already been spent 
on qualitative research. Managers who are unfamiliar with research will be very tempted to won- 
der, “Why do I need yet another study?” and “What did I spend all that money for?” Thus, they 
choose to proceed based only on exploratory results. Again, the researcher has fulfilled the profes- 
sional obligation as long as the tentative nature of any ideas derived from exploratory research has 
been relayed through the research report. 

Again, this isn’t always a bad approach. If the decision itself does not involve a great deal of 
risk or if it can be reversed easily, the best course of action may be to proceed to implementation 
instead of investing more money in confirmatory research. Remember, research shouldn’t be 
performed if it will cost more than it will return. 


EMOTION 


Time, money, and emotion are all related. Decision makers sometimes become so anxious to 
have something resolved, or they get so excited about some novel discovery resulting from a focus 
group interview, that they may act rashly. Perhaps some of the ideas produced during the motiva- 
tional research era sounded so enticing that decision makers got caught up in the emotion of the 
moment and proceeded without the proper amount of testing. Thus, as in life, when we fall in 
love with something, we are prone to act irrationally. The chances of emotion interfering in this 
way are lessened, but not reduced, by making sure multiple decision makers are involved in the 
decision process. 

In conclusion, we began this section by suggesting that exploratory, qualitative research can- 
not take the place of a confirmatory study. However, a confirmatory study cannot take the place 
of an exploratory, qualitative study either. While confirmatory studies are best for testing specific 
ideas, a qualitative study is far better suited to developing ideas and practical theories. 
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Summary 


1. List and understand the differences between qualitative research and quantitative 
research. The chapter emphasized that any argument about the overall superiority of qualitative 
versus quantitative research is misplaced. Rather, each approach has advantages and disadvantages 
that make it appropriate in certain situations. The presence or absence of numbers is not the key 
factor discriminating between qualitative and quantitative research. Qualitative research relies 
more on researchers’ subjective interpretations of text or other visual material. In contrast, the 
numbers produced in quantitative research are objective in the sense that they don’t change sim- 
ply because someone else computed them. Thus, we expect quantitative research to have inter- 
subjective certifiability, while qualitative research may not. Qualitative research typically involves 
small samples while quantitative research usually uses large samples. Qualitative procedures are 
generally more flexible and produce deeper and more elaborate explanations than quantitative 
research. 


2. Understand the role of qualitative research in exploratory research designs. The high degree 
of flexibility that goes along with most qualitative techniques makes it very useful in exploratory 
research designs. Therefore, exploratory research designs most often involve some qualitative 
research technique. 


3. Describe the basic qualitative research orientations. Phenomenology is a philosophical 
approach to studying human experiences based on the idea that human experience itself is inher- 
ently subjective and determined by the context within which a person experiences something. 
It lends itself well to conversational research. Ethnography represents ways of studying cultures 
through methods that include high involvement with that culture. Participant-observation is a 
common ethnographic approach. Grounded theory represents inductive qualitative investigation 
in which the researcher continually poses questions about a respondent’s discourse in an effort to 
derive a deep explanation of their behavior. Collages are sometimes used to develop grounded 
theory. Case studies simply are documented histories of a particular person, group, organization, 
or event. 


4. Prepare a focus group interview outline. A focus group outline should begin with introductory 
comments followed by a very general opening question that does not lead the respondent. More 
specific questions should be listed until a blunt question directly pertaining to the study objective 
is included. However, a skilled moderator can often lead the group without having to explicitly 
state these questions. It should conclude with debriefing comments and a chance for question- 
and-answers with respondents. 


5. Recognize technological advances in the application of qualitative research approaches. 
Videoconferencing and online chat rooms are more economical ways of trying to do much the 
same as traditional focus group interviews. Some companies have even established a focus blog 
that is a source for continuous commentary on a company. While they are certainly cost advanta- 
geous, there is less control over who participates. 


6. Recognize common qualitative research tools and know the advantages and limitations of their 
use. The most common qualitative research tools include the focus group interview and the depth 
interview. The focus group has some cost advantage per respondent because it would take ten 
times as long to conduct the interview portion(s) of a series of depth interviews compared to one 
focus group. However, the depth interview is more appropriate for discussing sensitive topics. 


7. Know the risks associated with acting on only exploratory results. Companies do make deci- 
sions using only exploratory research. There are several explanations for this behavior. The 
researcher’s job is to make sure that decision makers understand the increased risk that comes 
along with basing a decision only on exploratory research results. 


Key Terms and Concepts 


case studies, 140 ethnography, 138 free-association techniques, 152 
conversations, 151 field notes, 152 grounded theory, 139 
depth interview, 150 focus blog, 148 hermeneutic unit, 138 


discussion guide, 146 focus group interview, 141 hermeneutics, 138 
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intersubjective certifiability, 135 
laddering, 150 
moderator, 145 


piggyback, 143 


online focus group, 148 
participant-observation, 138 
phenomenology, 137 


quantitative data, 136 


projective technique, 153 
qualitative business research, 133 
qualitative data, 136 

quantitative business research, 134 
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replication, 154 

researcher-dependent, 133 

subjective, 135 

thematic apperception test (TAT), 153 
themes, 140 


Questions for Review and Critical Thinking 


1. Define qualitative and quantitative research. Compare and con- 
trast the two approaches. 

2. Why do exploratory research designs rely so much on qualita- 
tive research techniques? 

3. Why do causal designs rely so much on quantitative research 
techniques? 

4. What are the basic orientations of qualitative research? 

5. Of the four basic orientations of qualitative research, which 
do you think is most appropriate for a qualitative approach 
designed to better define a business situation prior to conduct- 
ing confirmatory research? 

6. What type of exploratory research would you suggest in the 
following situations? 

a. A product manager suggests development of a nontobacco 
cigarette blended from wheat, cocoa, and citrus. 

b. A research project has the purpose of evaluating potential 
names for a corporate spin-off. 

c. A human resource manager must determine the most 
important benefits of an employee health plan. 

d. An advertiser wishes to identify the symbolism associated 
with cigar smoking. 

7. What are the key differences between a focus group interview 
and a depth interview? 


Research Activities 


1. ‘NET How might the following organizations use an Internet 
chat room for exploratory research? 
a. A provider of health benefits 
b. A computer software manufacturer 
c. A video game manufacturer 

2. Go back to the opening vignette. What if Vans approached 
you to do a focus group interview that explored the idea of 
offering casual attire (off-board) aimed at their primary seg- 


ment (skateboarders) and offering casual attire for male retirees 


like Samuel Teel? How would you recommend the focus 


8. 


10. 


11. 


12. 


‘NET Visit some Web sites for large companies like Honda, 
Qantas Airlines, Target, Tesco, and Marriott. Is there any evi- 
dence that they are using their Internet sites in some way to 
conduct a continuous online focus blog or intermittent online 
focus groups? 

What is laddering? How might it be used in trying to understand 
which fast-food restaurant customers prefer? 

Comment on the following remark by a business consultant: 
“Qualitative exploration is a tool of research and a stimulant to 
thinking. In and by itself, however, it does not constitute busi- 
ness research.” 

ETHICS A researcher tells a manager of a wine company that he 
has some “cool focus group results” suggesting that respondents 
like the idea of a screw-cap to top wine bottles. Even before 
the decision maker sees the report, the manager begins purchas- 
ing screw-caps and the new bottling equipment. Comment on 
this situation. 

A packaged goods manufacturer receives many thousands of 
customer letters a year. Some are complaints, some are compli- 
ments. They cover a broad range of topics. Are these letters a 
possible source for exploratory research? Why or why not? 


group(s) proceed? Prepare a focus group outline(s) to accom- 
plish this task. 

Interview two people about their exercise behavior. In one 
interview, try to use a semi-structured approach by preparing 
questions ahead of time and trying to have the respondent com- 
plete answers for these questions. With the other, try a conver- 
sational approach. What are the main themes that emerge in 
each? Which approach do you think was more insightful? Do 
you think there were any “sensitive” topics that a respondent 
was not completely forthcoming about? 
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Case 7.1 Disaster and Consumer Value 


Edward Jones’ philosophy is to offer personalized services to 
individual clients starting with a one-on-one interview. During the 
interview, investment representatives seek to identify each client’s 
specific goals for investing. Richard G. Miller, one such represen- 
tative, says that he needs to thoroughly understand what a client 
wants before he can build an investment strategy for that person. 
His initial conversation starts with, “Hey, how are you?” Gregory 
L. Starry, another representative, confirms the Edward Jones phi- 
losophy: “Most of my day is spent talking with and meeting clients 
[rather than placing stock trades].” 

Only after learning these goals do the representatives design an 
investment strategy that will provide a client with income, growth, 


In February 2009, bushfires raced across the Questions 
Australian state of Victoria. This terrible tragedy 1. How could each orientation of qualitative research be used 

ne resulted in the loss of over 300 lives, Australia’s here? 
29 highest ever loss of life from a bushfire. In addi- 2. What qualitative research tool(s) would you recommend be 
Ee tion, more than 2,000 homes were destroyed used and why? 
ot | and insurance losses are estimated to exceed $2 3. Where would you conduct any interviews and with whom 

billion.” While rebuilding will take years, at some point after these would you conduct them? 

disasters, it is time to get back to business. But major catastrophic 4. ETHICS Are there ethical issues that you should be sensitive to 

events are likely to leave permanent changes on consumers and in this process? Explain. 

employees in the affected areas. 5. What issues would arise in conducting a focus group interview 

Suppose you are approached by the owner of several full-service in this situation? 

wine stores in Victoria. It is January 2010, and they want to get back 6. Prepare a focus group outline. 

to business. But they are uncertain about whether they should sim- 

ply maintain the same positioning they had previous to the bushfires. 

They would like to have a report from you within 60 days. 

Case 7.2 Edward Jones 

= E Edward Jones is one of the largest investment and safety. Each client’s goals also evolve over time. Young people 
| firms in the United States, with over 4,000 branch are focused on earning enough money to make a down payment 

ne offices in this country, Canada, and the United on their first home or to buy a car. Clients in the 35 to 45 age 
29 Kingdom. It is the only major brokerage firm that range are concerned about getting their children through school 
Es s exclusively targets individual investors and small and about their own retirement. Those in retirement want to make 
$2 businesses, and it has nearly 6 million clients. sure that they have an adequate income level. Miller notes, “It’s not 


the timing in the market, but the time in the market” that will help 
clients achieve their goals. 


Questions 

1. Many people in minority groups, including African Americans, 
Hispanic Americans, Asian Americans, and Native Americans, 
do not invest. What exploratory research should Edward Jones 
do to develop business with these minority markets? 

2. Another group with low investment activity includes those who 
stopped their education at the high school level. What factors 
should Edward Jones representatives consider in designing focus 
groups with these potential clients? 


CHAPTER 8 
SECONDARY DATA 


RESEARCH INA 
DIGITAL AGE 


1. Discuss the advantages and disadvantages of secondary 


data 
2. Define types of secondary data analysis conducted by 


business research managers 
3. Identify various internal and proprietary sources of 


secondary data 
4. Give examples of various external sources of secondary 


data 
5. Describe the impact of single-source data and globaliza- 
tion on secondary data research 


Chapter Vignette: Business Facts on a Grand Scale 

A key problem that faces any business research manager is the need to constantly capture relevant 
data about customers, competitors, and/or market characteristics. The use of secondary data (i.e., data 
that has been collected previously for other purposes) has exploded with the advent of large-scale 
electronic information sources and the Web. One company that has taken full advantage of integrat- 


ing various business related information sources is Nielsen Claritas. 
Prior to its merge with the Nielsen Company, Claritas (which in Latin 
means “brightness”) had a 40-year history of collecting and 
integrating business-related data from difference sources. Its 
products include (1) PRIZM, which provides market segmentation 
information based upon consumer behavior and geographic loca- 
tion; (2) Consumer Point, a target marketing analysis solution for 
different industry spaces; and (3) Business-Facts, which provides 
accurate business data for market support and strategic planning. 
Business-Facts holds great promise as a secondary data source 
for existing companies. Using Standard Industrial Classification (SIC) 
and North American Industry Classification (NAICS)' codes developed 
through the Census Bureau, characteristics on business ownership, 
location, employment, and sales are available for 10 major industrial 
groupings. Data and employee counts within the Business-Facts sys- 
“| tem represent over 13 million businesses. Examples of these industry 
groups include construction, manufacturing, and retail sales establish- 
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ments across the United States. Since business information can become quickly obsolete, Nielsen Claritas 
spends millions of dollars each year to verify business information on a quarterly basis. 
The advantages of knowing broadly both the characteristics and location of major customer 
groups (or potential competitors) are very real. Using a sophisticated statistical modeling approach, 
The Nielsen Claritas company can link your customers to your existing or proposed locations, in a 


fashion such that the information is as timely and applicable as possible. 
All of the information sources within Nielsen Claritas add value to business users by satisfying two 


very critical needs. First, Nielsen Claritas has expertise in linking different data streams into a cohesive 
system. This allows users to answer through secondary data sources critical existing business ques- 
tions. Secondly, their information systems are geographically based, so that businesses can query data 


to a common point on the globe. 
Truly, the integration and utilization of secondary data sources by the Nielsen Claritas Company 


has put business research “on the map”—both literally and figuratively! 
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Chapter 8: Secondary Data Research in a Digital Age 


Introduction 


Research projects often begin with secondary data, which are gathered and recorded by someone 
else prior to (and for purposes other than) the current project. Secondary data usually are historical 
and already assembled. They require no access to respondents or subjects. 


Advantages of Secondary Data 


The primary advantage of secondary data is their availability. Obtaining secondary data is almost 
always faster and less expensive than acquiring primary data. This is particularly true when research- 
ers use electronic retrieval to access data stored digitally. In many situations, collecting secondary 
data is instantaneous. 

Consider the money and time saved by researchers who obtained updated population esti- 
mates for a town during the interim between the 2000 and 2010 censuses. Instead of doing the 
fieldwork themselves, researchers could acquire estimates from a firm dealing in demographic 
information or from sources such as Claritas or PCensus. As in this example, the use of secondary 
data eliminates many of the activities normally associated with primary data collection, such as 
sampling and data processing. 

Secondary data are essential in instances when data cannot be obtained using primary data 
collection procedures. For example, a manufacturer of farm implements could not duplicate the 
information in the Census of Agriculture because much of the information there (for example, 
amount of taxes paid) might not be accessible to a private firm. 


Disadvantages of Secondary Data 


An inherent disadvantage of secondary data is that they were not designed specifically to meet the 
researchers’ needs. Thus, researchers must ask how pertinent the data are to their particular proj- 
ect. To evaluate secondary data, researchers should ask questions such as these: 


e Is the subject matter consistent with our problem definition? 

e Do the data apply to the population of interest? 

e Do the data apply to the time period of interest? 

e Do the secondary data appear in the correct units of measurement? 
e Do the data cover the subject of interest in adequate detail? 


Even when secondary information is available, it can be inadequate. Consider the following typi- 
cal situations: 


e A researcher interested in forklift trucks finds that the secondary data on the subject are 
included in a broader, less pertinent category encompassing all industrial trucks and tractors. 
Furthermore, the data were collected five years earlier. 

e An investigator who wishes to study individuals earning more than $100,000 per year finds the 
top category in a secondary study reported at $75,000 or more per year. 

e A brewery that wishes to compare its per-barrel advertising expenditures with those of com- 
petitors finds that the units of measurement differ because some report point-of-purchase 
expenditures with advertising and others do not. 

e Data from a previous warranty card study show where consumers prefer to purchase the prod- 
uct but provide no reasons why. 


The most common reasons why secondary data do not adequately satisfy research needs are 
(1) outdated information, (2) variation in definition of terms, (3) different units of measurement, 
and (4) lack of information to verify the data’s accuracy. Furthermore, in our rapidly changing 
environment, information quickly becomes outdated. Because the purpose of most studies is to 
predict the future, secondary data must be timely to be useful. 

Every primary researcher has the right to define the terms or concepts under investigation to 
satisfy the purpose of his or her primary investigation. This practice provides little solace, however, 
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secondary data 


Data that have been previously 
collected for some purpose other 
than the one at hand. 


—lIsaac Newton 


COURTESY OF QUALTRICS.COM 


The data in the online survey provide qualitative and quantita- While some of these data are centered on uni- 
tive data based upon responses from students around the world. versity experiences and attitudes, several data 


data conversion 


The process of changing the 
original form of the data to a 


format suitable to achieve the 


162 


research objective; also called 
data transformation. 


variables are similar to the kinds of 

data gathered from public opinion 

research. For example, take a look 

at some basic results (such as how 

many people strongly agree) on a few of the items 
in the online survey related to how a person's job 
affects them outside of work. Then, do a Google 
search on terms like “work tension opinions” and 
“work stress study.” Look at the linked docu- 
ments. Do the results obtained from the online 
survey appear consistent with other opinion 
study results? 


to the investigator of the African-American market who finds secondary data reported as “per- 
cent nonwhite.” Variances in terms or variable classifications should be scrutinized to determine 
whether differences are important. The populations of interest must be described in comparable 
terms. Researchers frequently encounter secondary data that report on a population of interest that 
is similar but not directly comparable to their population of interest. For example, Arbitron reports 
its television audience estimates by geographical areas known as ADIs (Areas of Dominant Influ- 
ence). An ADI is a geographic area consisting of all counties in which the home market commer- 
cial television stations receive a preponderance of total viewing hours. This unique population of 
interest is used exclusively to report television audiences. The geographic areas used in the census 
of population, such as Metropolitan Statistical Areas, are not comparable to ADIs. 

Units of measurement may cause problems if they do not conform exactly to a researcher’s 
needs as well. For example, lumber shipments in millions of board feet are quite different from 
billions of ton miles of lumber shipped on freight cars. Head-of-household income is not the 
same unit of measure as total family income. Often the objective of the original primary study 
may dictate that the data be summarized, rounded, or reported. When that happens, even if the 
original units of measurement were comparable, aggregated or adjusted units of measurement are 
not suitable in the secondary study. 

When secondary data are reported in a format that does not exactly meet the researcher’s needs, 
data conversion may be necessary. Data conversion (also called data transformation) is the process of 
changing the original form of data to a format more suitable for achieving a stated research objective. 
For example, sales for food products may be reported in pounds, cases, or dollars. An estimate of 
dollars per pound may be used to convert dollar volume data to pounds or another suitable format. 

Another disadvantage of secondary data is that the user has no control over their accuracy. 
Although timely and pertinent secondary data may fit the researcher’s requirements, the data could 
be inaccurate. Research conducted by other persons may be biased to support the vested interest 
of the source. For example, media often publish data from surveys to identify the characteristics of 
their subscribers or viewers, but they will most likely exclude derogatory data from their reports. 
If the possibility of bias exists, the secondary data should not be used. 

Investigators are naturally more prone to accept data from reliable sources such as the U.S. 
government. Nevertheless, the researcher must assess the reputation of the organization that gath- 
ers the data and critically assess the research design to determine whether the research was cor- 
rectly implemented. Unfortunately, such evaluation may be impossible without full information 
that explains how the original research was conducted. 
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Researchers should verify the accuracy of the data whenever possible. Cross-checks of data 
from multiple sources, similar to what Nielsen Claritas does with its Business-Facts database, 
should be made to determine the similarity of independent projects. When the data are not con- 
sistent, researchers should attempt to identify reasons for the differences or to determine which 
data are most likely to be correct. If the accuracy of the data cannot be established, the researcher 
must determine whether using the data is worth the risk. Exhibit 8.1 illustrates a series of questions 
that should be asked to evaluate secondary data before they are used. 


Do the data help to answer No > 
questions set out in the 


problem definition? 


v Yes 
Do the data apply to the are 
time period of interest? © 
vY 
Applicability > 
to the current Do the data apply to the o 
project population of interest? 9 Caninedeia 


be reworked? 
wv Yes If yes, No > sop 


Do other terms and variable continue 
Classifications presented 
apply to the current 
project? 


v Yes 


Are the units of 


measurement comparable? 


V Yes 


Accuracy of 
the data 


(inaccurate D 


or unsure) 


s No v Yes (accurate) 
Is using 
the data worth 


the risk? 
VNo 


Source: The idea for Exhibit 8.1 came from Robert W. Joselyn, Designing the Marketing Research Project (New York: 
Petrocelli/Charter, 1977). 
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cross-checks 


The comparison of data from one 
source with data from another 
source to determine the similarity 
of independent projects. 


EXHIBIT 8.1 
Evaluating Secondary Data 
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EXHIBIT 8.2 

Common Research 
Objectives for Secondary- 
Data Studies 


Secondary-data research 
supports the fact that breakfast 
sandwiches are at the top of the 


menu. 


Part 2: Beginning Stages of the Research Process 


Typical Objectives for Secondary-Data 
Research Designs 


It would be impossible to identify all the purposes of research using secondary data. However, 
some common business and marketing problems that can be addressed with secondary research 
designs are useful. Exhibit 8.2 shows three general categories of research objectives: fact-finding, 
model building, and database marketing. 


Broad Objective Specific Research Example 


Fact-finding Identifying consumption patterns 
Tracking trends 


Model building Estimating market potential 
Forecasting sales 
Selecting trade areas and sites 


Database marketing Enhancing customer databases 
Developing prospect lists 


Fact-Finding 


The simplest form of secondary-data research is fact-finding. A restaurant serving breakfast might 
be interested in knowing what new products are likely to entice consumers. Secondary data avail- 
able from National Eating Trends, a service of the NPD Group, show that the most potential may 
be in menu items customers can eat on the go.’ According to data from the survey of eating trends, 
take-out breakfasts have doubled over the past few years, and they have continued to surpass dine- 
in breakfast sales for over a decade. These trends make smoothies and breakfast sandwiches sound 
like a good bet for a breakfast 
menu. Also, NPD found that 
41 percent of breakfast sandwiches 
are consumed by people in their 
cars and 24 percent of people 
polled take them to work. These 
findings suggest that the sand- 
wiches should be easy to handle. 
But what to put on the biscuit or 
bun? Another research firm, Mar- 
ket Facts, says almost half of con- 
sumers say they would pay extra 
for cheese. These simple facts 
would interest a researcher who 
was investigating the market for 
take-out breakfasts. Fact-finding 
can serve more complex purposes 
as well. In the digital age we live 
in, the use of music as a means to 
notify users of a call is common- 
place. The Research Snapshot on 
the next page gives some of the 
amazing growth facts predicted in 
this industry. 


| ha; New Trends—Music for 
Mobile Phones 
Until a few years ago, selling music 
involved recordings on CDs, but marketing 
researchers have lately been tracking the newer 
practice of selling tunes to serve as ringtones. According to 
Nielsen, consumers spent nearly $600 million dollars on ring- 
tones in 2007. Strategy Analytics, a marketing research firm, 
forecasted that mobile music would generate $9 billion in sales 
by 2010 and much of that will be generated by ringtone sales. So 
far, the most popular song category is hip-hop, but videogame 
themes and movie themes also sell well. 

Ringtones are profitable for music sellers. Today, almost all 
ringtones sold are song clips known as mastertones or true tones, 
and consumers are sometimes paying more for ringtones ($2.49) 
than for an entire song downloaded to an MP3 player. The music 
companies, such as Sony and EMI, get royalties of up to 50 per- 
cent for mastertones. In this environment, Sony BMG skipped 


Secondary data from Nielsen reveals that these are among 
the most purchased ringtones for 2007: 


. Shop Boyz, “Party Like a Rockstar” 

. Mims, “This Is Why I’m Hot” 

. Soulja Boy, “Crank That (Soulja Boy)” 

. Nickelback, “Rockstar” 

. Akon, “Don’t Matter” 

. T-Pain, “Buy You A Drank (Shawty Snappin)” 
. Hurricane Chris, “A Bay Bay” 

. Sean Kingston, “Beautiful Girls” 

. Huey, “Pop, Lock & Drop It” 

. Fergie, “Big Girls Don’t Cry” 


DOAN AUN KBRWHNY — 


= 


Sources: Based on Maier, Matthew, “Digital Entertainment: Can Cell Phones Save 
the Music Business?” Business 2.0, (September 2005), downloaded from InfoTrac 
at http://www.galenet.com; Marek, Sue, “Ringing in the New Year,” Wireless 
Week, (January 1, 2006), http://www.galenet.com; “Music Marketing Gets Digital 
Tune-Up,” Financial Express, (January 28, 2006), http://www.galenet.com; 
“Nielsen Music 2007 Year-End Music Industry Report: Growth In Overall Music 


Purchases Exceeds 14%,” Wireless News, 

(January 10, 2008), http://www.tmcnet. 

com/usubmit/2008/01/10/3203970.htm, 
accessed August 6, 2008. 


the traditional approach of CD singles and MTV videos when 
Cassidy released an album in 2005; instead, the company made a 
25-second sample of Cassidy's song “I’m a Hustla” and released it 
as a ringtone. Coldplay's song “Speed of Sound” was available as a 
ringtone from Cingular before the album went on sale. 
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IDENTIFICATION OF CONSUMER BEHAVIOR 
FOR A PRODUCT CATEGORY 


A typical objective for a secondary research study might be to uncover all available information about 
consumption patterns for a particular product category or to identify demographic trends that affect an 
industry. For example, a company called Servigistics offers software that will scan a company’s own parts 
inventory data and compare it with marketing objectives and competitors’ prices to evaluate whether 
the company should adjust prices for its parts. Kia Motors tried using this service in place of the usual 
method of marking up cost by a set fraction. By considering secondary data including internal inven- 
tory data and external data about competitors’ prices, it was able to make service parts a more profitable 
segment of its business.’ This example illustrates the wealth of factual information about consumption 
and behavior patterns that can be obtained by carefully collecting and analyzing secondary data. 


TREND ANALYSIS 


Business researchers are challenged to constantly watch for trends in the marketplace and the envi- 
ronment. Market tracking is the observation and analysis of trends in industry volume and brand 


market tracking 


share over time. Scanner research services and other organizations provide facts about sales volume The observation and analysis of 
trends in industry volume and 


brand share over time. 


to support this work. 

Almost every large consumer goods company routinely investigates brand and product cat- 
egory sales volume using secondary data. This type of analysis typically involves comparisons with 
competitors’ sales or with the company’s own sales in comparable time periods. It also involves 
industry comparisons among different geographic areas. Exhibit 8.3 on the next page shows the 
trend in cola market share relative to the total carbonated soft-drink industry. 


Environmental Scanning 

In many instances, the purpose of fact-finding is simply to study the environment to identify trends. 
Environmental scanning entails information gathering and fact-finding designed to detect indications of 
environmental changes in their initial stages of development. The Internet can be used for environmen- 
tal scanning; however, there are other means, such as periodic review of contemporary publications 
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XHIBIT 8.3 
Cola’s Share of the 
Carbonated Soft-Drink 
Market 


model building 


The use of secondary data to help 
specify relationships between two 
or more variables; can involve the 
development of descriptive or 
predictive equations. 


Part 2: Beginning Stages of the Research Process 


Year 

1995 Sass 62.4% 
1996 61.9% 
1997 60.2% 

1998 . 59.7% 

1999 ——— = 58.8% 

2000 a ii 


0 20 40 60 80 100 
Percent of Market 


Source: Howard, Theresa, “Coca-Cola Hopes Taking New Path Leads to 
Success,” USA Today, March 6, 2001, p. 6b. From USA Today, a division 
of Gannett Co., Inc. Reprinted with Permission. 


and reports. For example, environmental scanning has shown many researchers that consumer demand 
in China is skyrocketing. In the case of beauty products such as cosmetics, Chinese authorities in the 
early 1990s stopped discouraging the use of makeup, and sales of these products took off—hitting $524 


million in 2005—and were expected to grow by over one-third, reaching $705 million by 2009. Com- 
panies including Procter & Gamble, L’Oréal, and Shiseido have captured a sizable share of this market 
by realizing the potential and developing products to get into the Chinese market early.* 

A number of online information services, such as Factiva and LexisNexis, routinely collect news 
stories about industries, product lines, and other topics of interest that have been specified by the 
researcher. In addition, push technology is an Internet information technology that automatically 
delivers content to the researcher’s or manager’s desktop. Push technology uses “electronic smart 
agents,” custom software that filters, sorts, prioritizes, and stores information for later viewing.’ This 
service frees the researcher from doing the searching. The true value of push technology is that the 
researcher who is scanning the environment can specify the kinds of news and information he or she 
wants, have it delivered to his or her computer quickly, and view it at leisure. 


Model Building 


The second general objective for secondary research, model building, is more complicated than 
simple fact-finding. Model building involves specifying relationships between two or more variables, 
perhaps extending to the development of descriptive or predictive equations, a technique that is used 
by the Nielsen Claritas Company routinely to add value to their secondary data. Models need not 
include complicated mathematics, though. In fact, decision makers often prefer simple models that 
everyone can readily understand over complex models that are difficult to comprehend. For exam- 
ple, market share is company sales divided by industry sales. Although some may not think of this 
simple calculation as a model, it represents a mathematical model of a basic relationship. 

We will illustrate model building by discussing three common objectives that can be satisfied 
with secondary research: estimating market potential, forecasting sales, and selecting potential 
facility or expansion sites. 


ESTIMATING MARKET POTENTIAL FOR GEOGRAPHIC AREAS 


Business researchers often estimate their company’s market potential using secondary data. In 
many cases exact figures may be published by a trade association or another source. However, 
when the desired information is unavailable, the researcher may estimate market potential by 
transforming secondary data from two or more sources. For example, managers may find second- 
ary data about market potential for a country or other large geographic area, but this information 
may not be broken down into smaller geographical areas, such as by metropolitan area, or in terms 
unique to the company, such as sales territory. In this type of situation, researchers often need to 
make projections for the geographic area of interest. 
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An extended example will help explain how secondary data can be used to calculate market 
potential. Suppose a brewing company is looking for opportunities to expand sales by exporting 
or investing in other countries. Managers decide to begin by estimating market potential for the 
Czech Republic, Germany, Japan, and Spain. Secondary research uncovered data for per capita 
beer consumption and population projections for the year 2010. The data for the four countries 
appear in Exhibit 8.4. 


Market Potential 


Population Projection 


Annual per Capita 


for 2010 Beer Consumption Estimate 
Country (thousands) (liters) (k liters) 
Czech Republic 10,175 157 1,597,475 
Germany 82,365 116 9,554,340 
Japan 127,758 48 6,132,384 
Spain 45,108 84 3,789,072 


Source: Population data from Population Division of the Department of Economic and Social Affairs of the United Nations 
Secretariat, “World Population Prospects: The 2004 Revision and World Urbanization Prospects; The 2003 Revision,” http:// 
esa.un.org/unpp, accessed February 9, 2006. Consumption data from “US Beer Consumption Reverses Decreases in 2007 - 
Research,” http://www. just-drinks.com/article.aspx?id =95643, November 24, 2007, accessed December 10, 2008, http:// 
galenet.galegroup.com; and “Czechs Top World Cup Beer Consumption,” http://www.worldcupblog.org/world-cup-2006/ 
czechs-top-world-beer-consumption.html, accessed December 10, 2008. 


To calculate market potential for the Czech Republic in 2010, multiply that country’s popula- 
tion in the year 2010 by its per capita beer consumption: 


10,175,000 people X 157 liters/person = 1,597,475, 000 liters 


In the Czech Republic, the market potential for beer is 1,597,475,000 liters. To get a sense of the 
expected sales volume, the researcher would have to multiply this amount by the price per liter 
at which beer typically sells in the Czech Republic. As Exhibit 8.4 reveals, Japan’s population is 
much higher, so its market potential is greater, even though the average Czech drinks much more 
beer. 

Of course, the calculated market potential for each country in Exhibit 8.4 is a rough esti- 
mate. One obvious problem is that not everyone in a country will be of beer-drinking age. If 
the researcher can get statistics for each country’s projected adult population, the estimate will be 
closer. Also, you might want to consider whether each country is experiencing growth or decline 
in the demand for beer to estimate whether consumption habits are likely to be different in 2010. 
For example, beer consumption is barely growing in Europe and Japan, but it is expanding in 
Latin America (at about 4 percent a year) and even faster in China (by at least 6 percent a year).° 
Perhaps this information will cause you to investigate market potential in additional countries 
where more growth is expected. 


FORECASTING SALES 


For any project, such as forecasting sales, you need information about the future. You will need 
to know what company sales will be next year and in future time periods. Sales forecasting is the 
process of predicting sales totals over a specific time period. 

Accurate sales forecasts, especially for products in mature, stable markets, frequently come 
from secondary-data research that identifies trends and extrapolates past performance into the 
future. Researchers often use internal company sales records to project sales. A rudimentary model 
would multiply past sales volume by an expected growth rate. A researcher might investigate a 
secondary source and find that industry sales are expected to grow by 10 percent; multiplying 
company sales volume by 10 percent would give a basic sales forecast. 

Exhibit 8.5 on the next page illustrates trend projection using a moving average projection 
of growth rates. Average ticket prices for a major-league baseball game are secondary data from 
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EXHIBIT 8.4 
Market Potential for Four 
Possible Beer Markets 
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Sales Forecast Using 
Secondary Data and Moving 
Averages 


site analysis techniques 


Techniques that use secondary 
data to select the best location 
for retail or wholesale operations. 


index of retail saturation 


A calculation that describes 
the relationship between retail 
demand and supply. 


Part 2: Beginning Stages of the Research Process 


Average Percentage Rate 3-Year Moving 

Ticket Price of Growth (Decline) Average Rate of 

($) from Previous Year Growth (Decline) 
1996 11.20 5.2% 3.5% 
1997 12.36 10.4% 5.8% 
1998 1859 10.0% 8.5% 
1999 14.91 9.7% 10.0% 
2000 16.67 11.8% 10.5% 
2001 18.99 13.9% 11.8% 
2002 18.30 -3.6% 7.4% 
2003 19:01 3.9% 47% 
2004 19.82 4.3% 1.5% 
2005 2117 6.8% 5.0% 
2006 2221 4.9% 5.3% 
2007 22.70 2.2% 4.6% 
2008 25.43 12.0% 6.4% 


Team Marketing Report for each year of interest (http://www.teammarketing.com/fancost/mlb/). The 
moving average is the sum of growth rates for the past three years divided by 3 (number of years). 
The resulting number is a forecast of the percentage increase in ticket price for the coming year. 
Using the three-year average growth rate of 6.4 percent for the 2008, 2007, and 2006 sales peri- 
ods, we can forecast the average ticket price for 2009 as follows: 


$25.43 + ($25.43 X .064) = $27.05 


Using the same information, the projected price of a beer at a ballgame in 2009 is $6.43. This lets 
the fan know how much to take out to the old ballgame. 

Moving average forecasting is best suited to a static competitive environment. More dynamic 
situations make other sales forecasting techniques more appropriate. 

Statistical trend analysis using secondary data can be much more advanced than this simple exam- 
ple. Many statistical techniques build forecasting models using secondary data. This chapter empha- 
sizes secondary-data research rather than statistical analysis, which is covered in later chapters. 


ANALYSIS OF TRADE AREAS AND SITES 


Managers routinely examine trade areas and use site analysis techniques to select the best locations 
for retail or wholesale operations. Secondary-data research helps managers make these site selec- 
tion decisions. Some organizations, especially franchisers, have developed special computer soft- 
ware based on analytical models to select sites for retail outlets. The researcher must obtain the 
appropriate secondary data for analysis with the computer software. 

The index of retail saturation offers one way to investigate retail sites and to describe the rela- 
tionship between retail demand and supply.’ It is easy to calculate once the appropriate secondary 
data are obtained: 


Local market potential (demand) 
Local market retailing space 


Index of retail saturation = 


For example, Exhibit 8.6 shows the relevant secondary data for shoe store sales in a five-mile 
radius surrounding a Florida shopping center. These types of data can be purchased from vendors 
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of market information such as Urban Decision Systems. First, to estimate local market potential 
(demand), we multiply population by annual per capita shoe sales. This estimate, line 3 in Exhibit 8.6, 
goes in the numerator to calculate the index of retail saturation: 


Index of retail saturation = a = 152 
1. Population 261,785 
2. Annual per capita shoe sales $54.43 
3. Local market potential (line 1 X line 2) $14,249,000 
4. Square feet of retail space used to sell shoes 94,000 sq. ft. 
5. Index of retail saturation (line 3/line 4) 152 


The retailer can compare this index figure with those of other areas to determine which sites 
have the greatest market potential with the least amount of retail competition. An index value 
above 200 is considered to indicate exceptional opportunities. 


Data Mining 


Large corporations’ decision support systems often contain millions or even hundreds of millions 
of records of data. These complex data volumes are too large to be understood by managers. Con- 
sider, for example, Capital One, a consumer lending company with nearly 50 million customer 
accounts, including credit cards and auto loans. Suppose the company collects data on customer 
purchases, and each customer makes five transactions in a month, or 60 per year. With 50 million 
customers and decades of data (the company was founded in 1988), it’s easy to see how record 
counts quickly grow beyond the comfort zone for most humans.* 

Two points about data volume are important to keep in mind. First, relevant data are often in 
independent and unrelated files. Second, the number of distinct pieces of information each data 
record contains is often large. When the number of distinct pieces of information contained in 
each data record and data volume grows too large, end users don’t have the capacity to make sense 
of it all. Data mining helps clarify the underlying meaning of the data. 

The term data mining refers to the use of powerful computers to dig through volumes of data 
to discover patterns about an organization’s customers and products. As seen in the Research 
Snapshot on the next page, this can even apply to Internet content from blogs. It is a broad term 
that applies to many different forms of analysis. For example, neural networks are a form of artifi- 
cial intelligence in which a computer is programmed to mimic the way that human brains process 
information. One computer expert put it this way: 


A neural network learns pretty much the way a human being does. Suppose you say “big” and show a 
child an elephant, and then you say “small” and show her a poodle. You repeat this process with a house 
and a giraffe as examples of “big” and then a grain of sand and an ant as examples of “small.” Pretty 
soon she will figure it out and tell you that a truck is “big” and a needle is “small.” Neural networks can 
similarly generalize by looking at examples.’ 


Market-basket analysis is a form of data mining that analyzes anonymous point-of-sale transac- 
tion databases to identify coinciding purchases or relationships between products purchased and 
other retail shopping information.'® Consider this example about patterns in customer purchases: 
Osco Drugs mined its databases provided by checkout scanners and found that when men go to 
its drugstores to buy diapers in the evening between 6:00 p.m. and 8:00 p.m., they sometimes 
walk out with a six-pack of beer as well. Knowing this behavioral pattern, supermarket managers 
may consider laying out their stores so that these items are closer together.'! 
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acini. 
Secondary Data for 
Calculating an Index of 
Retail Saturation 


data mining 


The use of powerful computers 
to dig through volumes of data 
to discover patterns about an 
organization's customers and 
products; applies to many 
different forms of analysis. 


neural networks 


A form of artificial intelligence in 
which a computer is programmed 
to mimic the way that human 
brains process information. 


market-basket analysis 


A form of data mining that ana- 
lyzes anonymous point-of-sale 
transaction databases to identify 
coinciding purchases or relation- 
ships between products pur- 
chased and other retail shopping 
information. 
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Mining Data from Blogs 


positive and negative messages and analyze 


One way to find out what people are thinking these days is to word choices and spelling to estimate the 
read what they are posting on their blogs. But with tens of mil- writer's age range and sex. The company’s 
lions of blogs available on the Internet, there is no way to read CEO, Howard Kaushansky, says the program 
them all. One solution: data-mining software designed for the can even recognize sarcasm. 
blogosphere. Most of Umbria’s clients are large mak- 

Umbria Communications, based in Boulder, Colorado, offers ers of consumer products, including Sprint and Electronic Arts. 
a program called Buzz Report, which searches 13 million blogs, U.S. Cellular used Buzz Report to learn that teenage users of 
looking for messages related to particular products and trends. cell phones are particularly worried about using more than 
Marketers can buy the service to find out what people are say- their allotted minutes, fearing that parents would take the extra 


ing about their new products, or they can explore unmet needs amount from their allowance. Such knowledge is useful for 


customer discovery 


Involves mining data to look for 
patterns identifying who is likely 
to be a valuable customer. 


database marketing 


The use of customer databases 
to promote one-to-one relation- 
ships with customers and create 

precisely targeted promotions. 
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in areas they might consider developing new service plans and marketing messages. 


meee Nor only does Buzz Sources: Based on Finn, Bridget, “Consumer Research: Mining Blogs for Marketing 
Report identify relevant blogs, Insight,” Business 2.0, 7 (September 1, 2006), http://money.cnn.com/magazines/ 
but it also has a language business2/business2_archive/2006/09/01/8384325/, accessed 3/30/09; Martin, Justin, 

P 4 “Blogging for Dollars,” Fortune (December 12, 2005), http://www.galenet.com. 
processor that can identify 


A data-mining application of interest to some researchers is known as customer discovery, 
which involves mining data to look for patterns identifying who is likely to be a valuable cus- 
tomer. For example, a larger provider of business services wanted to sell a new product to its 
existing customers, but it knew that only some of them would be interested. The company had to 
adapt each product offering to each customer’s individual needs, so it wanted to save money by 
identifying the best prospects. It contracted with a research provider called DataMind to mine its 
data on sales, responses to marketing, and customer service to look for the customers most likely 
to be interested in the new product. DataMind assigned each of the company’s customers an index 
number indicating their expected interest level, and the selling effort was much more efficient as 
a result.'” 

When a company knows the identity of the customer who makes repeated purchases from 
the same organization, an analysis can be made of sequences of purchases. The use of data min- 
ing to detect sequence patterns is a popular application among direct marketers, such as catalog 
retailers. A catalog merchant has information for each customer, revealing the sets of products 
that the customer buys in every purchase order. A sequence detection function can then be used 
to discover the set of purchases that frequently precedes the purchase of, say, a microwave oven. 
As another example, a sequence of insurance claims could lead to the identification of frequently 
occurring medical procedures performed on patients, which in turn could be used to detect cases 
of medical fraud. 

Data mining requires sophisticated computer resources, and it is expensive. That’s why 
companies like DataMind, IBM, Oracle, Information Builders, and Acxiom Corporation offer 
data-mining services. Customers send the databases they want analyzed and let the data~mining 


” 


company do the “number crunching. 


Database Marketing and Customer 
Relationship Management 


CRM (customer relationship management) systems are a decision support system that manage the 
interactions between an organization and its customers. A CRM maintains customer databases 
containing customers’ names, addresses, phone numbers, past purchases, responses to past promo- 
tional offers, and other relevant data such as demographic and financial data. Database marketing 
is the practice of using CRM databases to develop one-to-one relationships and precisely targeted 
promotional efforts with individual customers. For example, a fruit catalog company CRM contains 
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a database of previous customers, including what purchases they made during the Christmas holidays. 
Each year the company sends last year’s gift list to customers to help them send the same gifts to their 
friends and relatives. 

Because database marketing requires vast amounts of CRM data compiled from numerous 
sources, secondary data are often acquired for the exclusive purpose of developing or enhanc- 
ing databases. The transaction record, which often lists the item purchased, its value, customer 
name, address, and zip code, is the building block for many databases. This may be supplemented 
with data customers provide directly, such as data on a warranty card, and by secondary data 
purchased from third parties. For example, credit services may sell databases about applications 
for loans, credit card payment history, and other financial data. Several companies, such as Don- 
nelley Marketing (with its BusinessContentFile and ConsumerContentFile services) and Claritas 
(with PRIZM), collect primary data and then sell demographic data that can be related to small 
geographic areas, such as those with a certain zip code. (Remember that when the vendor collects 
the data, they are primary data, but when the database marketer incorporates the data into his or 
her database, they are secondary data.) 

Now that some of the purposes of secondary-data analysis have been addressed, we turn to a 
discussion of the sources of secondary data. 


Sources of Secondary Data 


Secondary data can be classified as either internal to the organization or external. Modern infor- 
mation technology makes this distinction seem somewhat simplistic. Some accounting documents 
are indisputably internal records of the organization. Researchers in another organization cannot 
have access to them. Clearly, a book published by the federal government and located at a public 
library is external to the company. However, in today’s world of electronic data interchange, the 
data that appear in a book published by the federal government may also be purchased from an 
online information vendor for instantaneous access and subsequently stored in a company’s deci- 
sion support system. 

Internal data should be defined as data that originated in the organization, or data created, 
recorded, or generated by the organization. Internal and proprietary data is perhaps a more descrip- 
tive term. 


Sources of Internal and Proprietary Data 


Most organizations routinely gather, record, and store internal data to help them solve future 
problems. An organization’s accounting system can usually provide a wealth of information. Rou- 
tine documents such as sales invoices allow external financial reporting, which in turn can be a 
source of data for further analysis. If the data are properly coded into a modular database in the 
accounting system, the researcher may be able to conduct more detailed analysis using the deci- 
sion support system. Sales information can be broken down by account or by product and region; 
information related to orders received, back orders, and unfilled orders can be identified; sales can 
be forecast on the basis of past data. Other useful sources of internal data include salespeople’s call 
reports, customer complaints, service records, warranty card returns, and other records. 

Researchers frequently aggregate or disaggregate internal data. For example, a computer ser- 
vice firm used internal secondary data to analyze sales over the previous three years, categorizing 
business by industry, product, purchase level, and so on. The company discovered that 60 percent 
of its customers represented only 2 percent of its business and that nearly all of these custom- 
ers came through telephone directory advertising. This simple investigation of internal records 
showed that, in effect, the firm was paying to attract customers it did not want. 

Internet technology is making it easier to research internal and proprietary data. Often com- 
panies set up intranets so that employees can use Web tools to store and share data within the 
organization. And just as Google’s search software lets people search the entire World Wide Web, 
Google is offering the enterprise search, which is essentially the same technology in a version 
that searches a corporate intranet. The enterprise search considers not only how often a particular 
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internal and proprietary 
data 


Secondary data that originate 
inside the organization. 
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external data 


Data created, recorded, or gener- 
ated by an entity other than the 
researcher's organization. 
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document has been viewed but also the history of the user’s past search patterns, such as how 
often that user has looked at particular documents and for how long. In addition, other companies 
have purchased specialized software, such as Autonomy, which searches internal sources plus such 
external sources as news government Web sites." 


External Data: The Distribution System 


External data are generated or recorded by an entity other than the researcher’s organization. The 
government, newspapers and journals, trade associations, and other organizations create or pro- 
duce information. Traditionally, this information has been in published form, perhaps available 
from a public library, trade association, or government agency. Today, however, computerized 
data archives and electronic data interchange make external data as accessible as internal data. 
Exhibit 8.7 illustrates some traditional and some modern ways of distributing information. 


Information as a Product and Its Distribution Channels 


Because secondary data have value, they can be bought and sold like other products. And just 
as bottles of perfume or plumbers’ wrenches may be distributed in many ways, secondary data 
also flow through various channels of distribution. Many users, such as the Fortune 500 corpora- 
tions, purchase documents and computerized census data directly from the government. How- 
ever, many small companies get census data from a library or another intermediary or vendor of 
secondary information. 


LIBRARIES 


Traditionally, libraries’ vast storehouses of information have served as a bridge between users and 
producers of secondary data. The library staff deals directly with the creators of information, such 
as the federal government, and intermediate distributors of information, such as abstracting and 
indexing services. The user need only locate the appropriate secondary data on the library shelves. 
Libraries provide collections of books, journals, newspapers, and so on for reading and reference. 
They also stock many bibliographies, abstracts, guides, directories, and indexes, as well as offer 
access to basic databases. 

The word library typically connotes a public or university facility. However, many major cor- 
porations and government agencies also have libraries. A corporate librarian’s advice on sources of 
industry information or the United Nations librarian’s help in finding statistics about international 
markets can be invaluable. 


THE INTERNET 


Today, of course, much secondary data is conveniently available over the Internet. Its creation has 
added an international dimension to the acquisition of secondary data. For example, Library Spot, 
at http://www.libraryspot.com, provides links to online libraries, including law libraries, medical librar- 
ies, and music libraries. Its reference desk features links to calendars, dictionaries, encyclopedias, 
maps, and other sources typically found at a traditional library’s reference desk. 

Exhibit 8.8 on page 174 lists some of the more popular Internet addresses where secondary 
data may be found. 


VENDORS 


The information age offers many channels besides libraries through which to access data. Many 
external producers make secondary data available directly from the organizations that produce the 
data or through intermediaries, which are often called vendors. Vendors such as Factiva now allow 
managers to access thousands of external databases via desktop computers and telecommunications 
systems. Hoovers (http://www.hoovers.com) specializes in providing information about thousands of 
companies’ financial situations and operations. 


Chapter 8: Secondary Data Research in a Digital Age 173 


EXHIBIT 8.7 
Information as a Product 
Indirect Channel and Its Distribution 
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Modern Distribution of Secondary Data 
Indirect Computerized Distribution Using an Intermediary 
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Traditional Distribution of Secondary Data 
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Direct, Computerized Distribution 
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E PRODUCERS 


Classifying external secondary data by the nature of the producer of information yields five basic 
sources: publishers of books and periodicals, government sources, media sources, trade association 
sources, and commercial sources. The following section discusses each type of secondary data source. 
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Selected Internet Sites for 
Secondary Data 


—Mark Twain 


Yahoo! 


CEOexpress 


The New York Public Library 


Home Page 


Census Bureau 


Statistical Abstract of the 
United States 


STAT-USA/Internet 


Advertising Age magazine 


Inc.com 


The Wall Street Journal Online 


CNN Money 


NAICS—North American 
Industry Classification System 


MapQuest 


Brint.com: The BizTech 
Network 


Books and Periodicals 
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Description 


Portal that serves as a gateway 


to all kinds of sites on the Web. 


The 80/20 rule applied to 

the Internet. A series of links 
designed by a busy executive 
for busy executives. 


Library resources and links 
available online. 


Demographic information 
from the U.S. Census Bureau. 


Highlights from the 
primary reference book for 
government statistics. 


A comprehensive source of 
U.S. government information 
that focuses on economic, 
financial, and trade data. 


Provides content on marketing 
media, advertising, and public 
relations. 


Inc. magazine's resources for 
growing a small business. 


Provides a continually updated 
view of business news around 
the world. 


Provides business news, 
information on managing 
a business and managing 
money, and other business 
data. 


Describes the new 
classification system that 
replaced the SIC system. 


Allows users to enter an 
address and zip code and 
see a map. 


Business and technology 
portal and global network 
for e-business, information, 
technology, and knowledge 
management. 


URL 


http://www.yahoo.com 


http://www.ceoexpress.com 


http://www.nypl.org 


http://www.census.gov 


http://www.census.gov/ 
statab/www 


http://www.stat-usa.gov/ 


http://www.adage.com 


http://www.inc.com 


http://online.wsj.com 


http://money.cnn.com 


http://www.census.gov/epcd/ 
www/naics.html 


http://www.mapquest.com 


http://www.brint.com 


Some researchers consider books and periodicals found in a library to be the quintessential sec- 


ondary data source. A researcher who finds books on a topic of interest obviously is off to a good 


start. 


Professional journals, such as the Journal of Marketing, Journal of Management, Journal of the Acad- 


emy of Marketing Science, The Journal of Business Research, Journal of Advertising Research, American 


Demographics, and The Public Opinion Quarterly, as well as commercial business periodicals such as 


the Wall Street Journal, Fortune, and BusinessWeek, contain much useful material. Sales and Marketing 


Management’s Survey of Buying Power is a particularly useful source of information about markets. 
To locate data in periodicals, indexing services such as the ABI/INFORM and Business Periodicals 
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Index and the Wall Street Journal Index are very useful. Guides to data sources also are helpful. For 
example, American Statistical Index and Business Information Sources is a very valuable source. Most 
university libraries provide access to at least some of these databases. 


Government Sources 

Government agencies produce data prolifically. Most of the data published by the federal govern- 
ment can be counted on for accuracy and quality of investigation. Most students are familiar with 
the U.S. Census of Population, which provides a wealth of data. 

The Census of Population is only one of many resources that the government provides. Banks 
and savings and loan companies rely heavily on the Federal Reserve Bulletin and the Economic Report 
of the President for data relating to research on financial and economic conditions. Builders and 
contractors use the information in the Current Housing Reports and American Housing Survey for 
their research. The Statistical Abstract of the United States is an extremely valuable source of informa- 
tion about the social, political, and economic organizations of the United States. It abstracts data 
available in hundreds of other government publications and serves as a convenient reference to 
more specific statistical data. 

The federal government is a leader in making secondary data available on the Internet. Visit 
FedWorld (http://www.fedworld.gov) for a central access point and links to many of these important 
documents. STAT-USA/Internet is another authoritative and comprehensive source of U.S. gov- 
ernment information that focuses on economic, financial, and trade data. It contains the following 
types of information: 


e More than 18,000 market research reports on individual countries and markets compiled by 
foreign experts at U.S. embassies 

e Economic data series, current and historical, such as gross domestic product, balance of pay- 
ment, and merchandise trade 

¢ Standard reference works, such as the Economic Report of the President, the Budget of the United 
States Federal Government, and the World Factbook 

e Worldwide listings of businesses interested in buying U.S. products 


The STAT-USA/Internet Web address is http://www.stat-usa.gov. However, only subscribers who 
pay a fee have access to this service. 

State, county, and local government agencies can also be useful sources of information. Many 
state governments publish state economic models and forecasts, and many cities have metropolitan 
planning agencies that provide data about the population, economy, transportation system, and so 
on. These are similar to federal government data but are more current and are structured to suit 
local needs. 

Many cities and states publish information on the Internet. Many search engines have direc- 
tory entries that allow easy navigation to a particular state’s Web site. A researcher using Yahoo!, 
for example, needs only to click Regional Information to find numerous paths to information 
about states. 


Media Sources 
Information on a broad range of subjects is available from broadcast and print media. CNN Finan- 
cial News and BusinessWeek are valuable sources for information on the economy and many indus- 
tries. Media frequently commission research studies about various aspects of Americans’ lives, 
such as financial affairs, and make reports of survey findings available to potential advertisers free 
of charge. Data about the readers of magazines and the audiences for broadcast media typically are 
profiled in media kits and advertisements. 

Information about special-interest topics may also be available. Hispanic Business reports that 
the number of Hispanic-owned companies in the United States is expected to grow at a rate of 55 
percent between 2004 and 2010, reaching 3.2 million firms, with revenue growth for the period 
of 70 percent. According to the magazine, most of these firms are located in 20 states, with over 
half in California and Florida. For researchers willing to pay a modest $85, Hispanic Business offers 
a more detailed report about Hispanic-owned businesses.'* 

Data such as these are plentiful because the media like to show that their vehicles are viewed 
or heard by advertisers’ target markets. These types of data should be evaluated carefully, however, 
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Water, Water Everywhere (in a bottle) 


1976, the average person drank 1.6 gallons of 


Most people would consider water to be relatively free. The bottled water per year. Thirty years later, that 

ever-present bottle of water that you see in people’s hands is average is 27.6 gallons per year. As a result, 

a common sight, yet it is a relatively new trend in the bever- researchers have begun to build data around 

age industry. In some ways, it does not seem to make sense this growing industry segment. Within this 
that something available $8.3 billion industry, wholesale dollar sales and 
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everywhere can represent an market share heavily favor familiar beverage brands such as Dasani 
industry. When asked why a (Coca-Cola) and Aquafina (PepsiCo), but the largest producer of 
bottle of water which is typi- bottled water is actually Nestlé Waters of North America, producer 


cally priced at over a dollar of several brands such as Ozarka and Poland Springs. 

per bottle is the beverage These data are useful to other researchers who wish to ana- 
of choice, consumers rou- lyze the traditional and non-traditional beverage industry. So, the 
tinely see it as a healthy and next time you “grab your water,” you are contributing to a rela- 
convenient “beverage” in tively new industry that has somehow made water even more a 
today’s world. part of our lives. 


The trend for bottled MEMS! Source: Beverage World (April 2006); International Bottled Water Association, http:// 
consumption is exploding—in — www.bottledwater.org. 


because often they cover only limited aspects of a topic. Nevertheless, they can be quite valuable 
for research, and they are generally available free of charge. 


Trade Association Sources 

Trade associations, such as the Food Marketing Institute or the American Petroleum Institute, 
serve the information needs of a particular industry. The trade association collects data on a num- 
ber of topics of specific interest to firms, especially data on market size and market trends. Associa- 
tion members have a source of information that is particularly germane to their industry questions. 
For example, the Newspaper Advertising Bureau (NAB) has catalogued and listed in its computer 
the specialized sections that are currently popular in newspapers. The NAB has surveyed all daily, 
Sunday, and weekend newspapers in the United States and Canada on their editorial content and 
has stored this information, along with data on rates, circulation, and mechanical requirements, in 
its computer for advertisers’ use. As seen in the Research Snapshot above, trade associations are 
valuable sources of interesting data. 


Commercial Sources 

Numerous firms specialize in selling and/or publishing information. For example, the Polk Com- 
pany publishes information on the automotive field, such as average car values and new-car pur- 
chase rates by zip code. Many of these organizations offer information in published formats and 
as CD-ROM or Internet databases. The following discussion of several of these firms provides a 
sampling of the diverse data that are available. 


Market-Share Data. A number of syndicated services supply either wholesale or retail sales 
volume data based on product movement. Information Resources, Inc., collects market-share 
data using Universal Product Codes (UPC) and optical scanning at retail store checkouts. 
INFOSCAN is a syndicated store tracking service that collects scanner data weekly from more 
than 32,000 supermarket, drug, and mass merchandiser outlets across the United States. Sales in 
France, Germany, Greece, Italy, the Netherlands, Spain, and the United Kingdom also are tracked 
by INFOSCAN. 

Although it is best known for its television rating operations, ACNielsen also has a scanner- 
based marketing and sales information service called ScanTrack. This service gathers sales and 
marketing data from a sample of more than 4,800 stores representing more than 800 retailers in 
50 major U.S. markets. As part of Nielsen’s Retail Measurement Service, auditors visit the stores 
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at regular intervals to track promotions to customers, retail inventories, displays, brand distribu- 
tion, out-of-stock conditions, and other retail marketing activity. Scanner data allow researchers 
to monitor sales data before, during, and after changes in advertising frequency, price changes, 
distribution of free samples, and similar marketing tactics. 

Wal-Mart operates its own in-store scanner system called RetailLink. Key suppliers can have 
online access to relevant data free of charge. The Market Share Reporter is produced each year, 
made available for sale, and provides market share data for most industries. 

Many primary data investigations use scanner data to measure the results of experimental 
manipulations such as altering advertising copy. For example, scanning systems combined with 
consumer panels are used to create electronic test-markets. Systems based on UPCs (bar codes) 
and similar technology have been implemented in factories, warehouses, and transportation com- 
panies to research inventory levels, shipments, and the like. 


Demographic and Census Updates. A number of firms, such as CACI Marketing Systems and 
Urban Information Systems, offer computerized U.S. census files and updates of these data broken 
down by small geographic areas, such as zip codes. Many of these research suppliers provide in- 
depth information on minority customers and other market segments. 


Consumer Attitude and Public Opinion Research. Many research firms offer specialized 
syndicated services that report findings from attitude research and opinion polls. For example, 
Yankelovich provides custom research, tailored for specific projects, and several syndicated ser- 
vices. Yankelovich’s public opinion research studies, such as the voter and public attitude surveys 
that appear in Time and other news magazines, are a source of secondary data. One of the firm’s 
services is the Yankelovich MONITOR, a syndicated annual census of changing social values and 
an analysis of how they can affect consumer marketing. The MONITOR charts the growth and 
spread of new social values, characterizes the types of customers who support the new values and 
those who continue to support traditional values, and outlines the ways in which people’s values 
affect purchasing behavior. 

Harris/Interactive is another public opinion research firm that provides syndicated and custom 
research for business. One of its services is its ABC News/Harris survey. This survey, released 
three times per week, monitors the pulse of the American public on topics such as inflation, 
unemployment, energy, attitudes toward the president, elections, and so on. 


Consumption and Purchase Behavior Data. NPD’s National Eating Trends (NET) is the most 
detailed database available on consumption patterns and trends for more than 4,000 food and bev- 
erage products. This is a syndicated source of data about the types of meals people eat and when 
and how they eat them. The data, called diary panel data, are based on records of meals and diaries 
kept by a group of households that have agreed to record their consumption behavior over an 
extended period of time. 

National Family Opinion (NFO), Marketing Research Corporation of America (MRCA), 
and many other syndicated sources sell diary panel data about consumption and purchase behav- 
ior. Since the advent of scanner data, diary panels are more commonly used to record purchases 
of apparel, hardware, home furnishings, jewelry, and other durable goods, rather than purchases 
of non-durable consumer packaged goods. More recently, services have been tracking consumer 
behavior online, collecting data about sites visited and purchases made over the Internet. 


Advertising Research. Advertisers can purchase readership and audience data from a number 
of firms. W. R. Simmons and Associates measures magazine audiences; Arbitron measures radio 
audiences; ACNielsen Media Measurement estimates television audience ratings. By specializing 
in collecting and selling audience information on a continuing basis, these commercial sources 
provide a valuable service to their subscribers. 

Assistance in measuring advertising effectiveness is another syndicated service. For example, 
Roper Starch Worldwide measures the impact of advertising in magazines. Readership informa- 
tion can be obtained for competitors’ ads or the client’s own ads. Respondents are classified as 
noted readers, associated readers, or read-most readers. 

Burke Marketing Research provides a service that measures the extent to which respondents 
recall television commercials aired the night before. It provides product category norms, or aver- 
age DAR (Day-After Recall) scores, and DAR scores for other products. 


177 


178 


single-source data 


Diverse types of data offered by 
a single company; usually inte- 
grated on the basis of a common 
variable such as geographic area 
or store. 


Examples of Single-Source 
Databases 
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An individual advertiser would be unable to monitor every minute of every television pro- 
gram before deciding on the appropriate ones in which to place advertising. However, numer- 
ous clients, agencies, television networks, and advertisers can purchase the Nielsen television 
ratings service. 


Single-Source Data-Integrated Information 


ACNielsen Company offers data from both its television meters and scanner operations. The inte- 
gration of these two types of data helps marketers investigate the impact of television advertising 
on retail sales. In other ways as well, users of data find that merging two or more diverse types of 
data into a single database offers many advantages. 

PRIZM by Nielsen Claritas, CACI, ClusterPlus by SMI, Mediamark Research Inc., and many 
other syndicated databases report product purchase behavior, media usage, demographic charac- 
teristics, lifestyle variables, and business activity by geographic area such as zip code. Although 
such data are often called geodemographic, they cover such a broad range of phenomena that no one 
name is a good description. These data use small geographic areas as the unit of analysis. 

The data and information industry uses the term single-source data for diverse types of data 
offered by a single company. Exhibit 8.9 identifies three major marketers of single-source data. 


CACI Marketing Systems Provides industry-specific marketing services, such as 

http://www.caci.com customer profiling and segmentation, custom target 
analysis, demographic data reports and maps, and site 
evaluation and selection. CACI offers demographics 
and data on businesses, lifestyles, consumer 
spending, purchase potential, shopping centers, 
traffic volumes, and other statistics. 


PRIZM by Claritas Corporation PRIZM, which stands for Potential Rating Index for 

http://www.claritas.com Zip Markets, is based on the “birds-of-a-feather” 
assumption that people live near others who are like 
themselves. PRIZM combines census data, consumer 
surveys about shopping and lifestyle, and purchase 
data to identify market segments. Colorful names 
such as Young Suburbia, Shot Guns, and Pickups 
describe 40 segments that can be identified by zip 
code. Claritas also has a lifestyle census in the United 
Kingdom (http://www.claritas.co.uk). 


MRI Cable Report—Mediamark Integrates information on cable television 
Research Inc. viewing with demographic and product 
http://www.mediamark.com usage information. 


Sources for Global Research 


As business has become more global, so has the secondary data industry. The Japan Management 
Association Research Institute, Japan’s largest provider of secondary research data to govern- 
ment and industry, maintains an office in San Diego. The Institute’s goal is to help U.S. firms 
access its enormous store of data about Japan to develop and plan their business there. The office 
in San Diego provides translators and acts as an intermediary between Japanese researchers and 
U.S. clients. 

Secondary data compiled outside the United States have the same limitations as domestic sec- 
ondary data. However, international researchers should watch for certain pitfalls that frequently 
are associated with foreign data and cross-cultural research. First, data may simply be unavail- 
able in certain countries. Second, the accuracy of some data may be called into question. This is 
especially likely with official statistics that may be adjusted for the political purposes of foreign 
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| A Around the World of Data + Japan 
SS ~ With the Internet, we can quickly go http://www.stat.go.jp 


around the world and find data. Many 
countries have Web sites that summarize basic 
characteristics with data tables. Here are just a few 
of the many Web sites that make finding data about different 
parts of the world easier: 


RUK 


http://www.statistics.gov.uk 


e France 
http://www.insee.fr 


« South America 


+ United States 
aul Sere http://www.internetworldstats.com/south.htm 


http://www.stat-usa.gov 


+ South Africa 
http://www.statssa.gov.za 


- Norway 
http://www.ssb.no 


« United Nations 


e Australia 
http://www.un.org/esa 


http://www.nla.gov.au/oz/stats.html 


OCEAN | 


governments. Finally, although economic terminology may be standardized, various countries use 
different definitions and accounting and recording practices for many economic concepts. For 
example, different countries may measure disposable personal income in radically different ways. 
International researchers should take extra care to investigate the comparability of data among 
countries. The Research Snapshot above provides some of the many Web site locations for data 
from around the world. 

The U.S. government and other organizations compile databases that may aid international 
secondary data needs. For example, The European Union in the U.S. (http://www.eurunion.org) reports 
on historical and current activity in the European Union providing a comprehensive reference 
guide to information about laws and regulations. The European Union in the U.S. profiles in detail 
each European Union member state, investment opportunities, sources of grants and other fund- 
ing, and other information about business resources. 

The U.S. government offers a wealth of data about foreign countries. The CIA’s World Fact- 
book and the National Trade Data Bank are especially useful. Both can be accessed using the Inter- 
net. The National Trade Data Bank (NTDB), the U.S. government’s most comprehensive source 
of world trade data, illustrates what is available. 

The National Trade Data Bank was established by the Omnibus Trade and Competitiveness 
Act of 1988.'° Its purpose was to provide “reasonable public access, including electronic access” to 
an export promotion data system that was centralized, inexpensive, and easy to use. 

The U.S. Department of Commerce has the responsibility for operating and maintaining the 
NTDB and works with federal agencies that collect and distribute trade information to keep the 
NTDB up-to-date. The NTDB has been published monthly on CD-ROM since 1990. Over one 
thousand public and university libraries offer access to the NTDB through the Federal Depository 
Library system. 

The National Trade Data Bank consists of 133 separate trade- and business-related programs 
(databases). By using it, small- and medium-sized companies get immediate access to information 
that until now only Fortune 500 companies could afford. 

Topics in the NTDB include export opportunities by industry, country, and product; foreign 
companies or importers looking for specific products; how-to market guides; demographic, politi- 
cal, and socioeconomic conditions in hundreds of countries; and much more. NTDB offers one- 
stop shopping for trade information from more than 20 federal sources. You do not need to know 
which federal agency produces the information: All you need to do is consult NTDB. 

Some of the specific information that can be obtained from the NTDB is listed in 
Exhibit 8.10 on the next page. 
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Always consider the possibility that secondary data may exist 
which can address the research question at hand. 

Only rely on secondary data that are reliable and valid. 
Generally, the reliability and validity are established by details 
the data source provides about how the data were collected 
and processed. 

Only rely on secondary data for which the units of measure 
are clear. 

Secondary data are particularly useful for trend analysis, 
environmental scanning, and estimating market potential for 
geographic areas. 


EXHIBIT 8.10 


Examples of Information 


Contained in the NTDB 
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Basic export information 


Calendars of trade fairs and exhibitions 


Capital markets and export financing 


Government sites such as the Census 
Bureau (www.census.gov), the CIA 
Factbook (www.cia.gov), and STAT-USA 
(www.stat-usa.gov) are great sources for 
geodemographic data about locations 
and peoples around the world. 


Agricultural commodity production and trade 


Country reports on economic and social policies and trade practices 


Energy production, supply, and inventories 


Exchange rates 


Export licensing information 


Guides to doing business in foreign countries 


International trade terms directory 


How-to guides 


International trade regulations/agreements 


International trade agreements 


Labor, employment, and productivity 


Maritime and shipping information 
Market research reports 


Overseas contacts 


Overseas and domestic industry information 


Price indexes 

Small business information 
State exports 

State trade contacts 

Trade opportunities 


U.S. export regulations 


U.S. import and export statistics by country and commodity 


U.S. international transactions 
World Factbook 


World minerals production 
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Summary 


1. Discuss the advantages and disadvantages of secondary data. Secondary data are data that 
have been gathered and recorded previously by someone else for purposes other than those of 
the current researcher. The chief advantage of secondary data is that they are almost always less 
expensive to obtain than primary data. Generally they can be obtained rapidly and may provide 
information not otherwise available to the researcher. The disadvantage of secondary data is that 
they were not intended specifically to meet the researcher’s needs. The researcher must examine 
secondary data for accuracy, bias, and soundness. One way to do this is to cross-check various 
available sources. 


2. Define types of secondary data analysis conducted by business research managers. Secondary 
research designs address many common business research problems. There are three general cat- 
egories of secondary research objectives: fact-finding, model building, and database marketing. 
A typical fact-finding study might seek to uncover all available information about consumption 
patterns for a particular product category or to identify business trends that affect an industry. 
Model building is more complicated; it involves specifying relationships between two or more 
variables. The practice of database marketing, which involves maintaining customer databases 
with customers’ names, addresses, phone numbers, past purchases, responses to past promotional 
offers, and other relevant data such as demographic and financial data, is increasingly being sup- 
ported by business research efforts. 


3. Identify various internal and proprietary sources of secondary data. Managers often get data 
from internal proprietary sources such as accounting records. Data mining is the use of powerful 
computers to dig through volumes of data to discover patterns about an organization’s customers 
and products. It is a broad term that applies to many different forms of analysis. 


4. Give examples of various external sources of secondary data. External data are generated or 
recorded by another entity. The government, newspaper and journal publishers, trade associa- 
tions, and other organizations create or produce information. Traditionally this information has 
been distributed in published form, either directly from producer to researcher, or indirectly 
through intermediaries such as public libraries. Modern computerized data archives, electronic 
data interchange, and the Internet have changed the distribution of external data, making them 
almost as accessible as internal data. Push technology is a term referring to an Internet information 
technology that automatically delivers content to the researcher’s or manager’s desktop. This 
service helps in environmental scanning. 


5. Describe the impact of single-source data and globalization on secondary data research. The 
marketing of multiple types of related data by single-source suppliers has radically changed the 
nature of secondary-data research. Businesses can measure promotional efforts and related buyer 
behavior by detailed customer characteristics. As business has become more global, so has the 
secondary-data industry. International researchers should watch for pitfalls that can be associated 
with foreign data and cross-cultural research, such as problems with the availability and reli- 


ability of data. 


Key Terms and Concepts 


cross-checks, 163 external data, 172 model building, 166 
customer discovery, 170 index of retail saturation, 168 neural networks, 169 
data conversion, 162 internal and proprietary data, 171 secondary data, 161 
data mining, 169 market tracking, 165 single-source data, 178 


database marketing, 170 market-basket analysis, 169 site analysis techniques, 168 
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Questions for Review and Critical Thinking 


Secondary data have been called the first line of attack for busi- 

ness researchers. Discuss this description. 

Suppose you wish to learn about the size of the soft-drink 

market, particularly root beer sales, growth patterns, and 

market shares. Indicate probable sources for these secondary 

data. 

What is push technology? 

Identify some typical research objectives for secondary-data 

studies. 

How might a researcher doing a job for a company such as 

Pulte Homes (http://www.pultehomes.com) or David Weekley 

Homes (http://www.davidweekley.com) use secondary data and 

data mining? 

What would be a source for the following data? 

a. Population, average income, and employment rates for 
Oregon 

b. Maps of U.S. counties and cities 

c. Trends in automobile ownership 

d. Divorce trends in the United States 

e. Median weekly earnings of full-time, salaried workers for 
the previous five years 


f. Annual sales of the top ten fast-food companies 
g. Top ten Web sites ranked by number of unique visitors 
h. Attendance at professional sports events 


Research Activities 


Use secondary data to learn the size of the U.S. golf market and 

to profile the typical golfer. 

‘NET Where could a researcher working for the U.S. Marine 

Corps (http://www.marines.com) find information that would 

identify the most productive areas of the United States in which 

to recruit? What would you recommend? 

‘NET PopClocks estimate the U.S. and world populations. Go 

to the Census Bureau home page (http://www.census.gov), navi- 

gate to the population section, and find today’s estimate of the 

U.S. and world populations. 

‘NET Try to find the U.S. market share for the following 

companies within 30 minutes: 

a. Home Depot 

b. Burger King 

c. Marlboro 

d. Was this a difficult task? If so, why do you think it is this 
difficult? 

‘NET Use the Internet to learn what you can about Indonesia. 

a. Check the corruption index for Indonesia at http://www. 
transparency.org. 

b. What additional kinds of information are available from the 
following sources? 


T: 


Suppose you are a business research consultant and a client 

comes to your office and says, “I must have the latest informa- 

tion on the supply of and demand for Maine potatoes within 

the next 24 hours.” What would you do? 

Find the following data in the Survey of Current Business: 

a. U.S. gross domestic product for the first quarter of 2006 

b. Exports of goods and services for the fourth quarter of 2006 

c. Imports of goods and services for the fourth quarter of 
2006 

ETHICS A newspaper reporter finds data in a study that sur- 

veyed children that reports a high percentage of children can 

match cartoon characters with the products they represent. 

For instance, they can match cereal with Captain Crunch and 

Ronald McDonald with a Big Mac. The reporter used this 

to write a story about the need to place limits on the use of 

cartoon characters. However, the study also provided data sug- 

gesting that matching the cartoon character and the product did 

not lead to significantly higher consumption. Would this be a 

proper use of secondary data? 


+ Go to http://freetheworld.com/member.html and view info 
for Indonesia. 
e Visit the CIA’s World Factbook at http://www.cia.gov/cia/ 
publications/factbook. 
* Go to Google, Yahoo! Search, or another search engine, 
and use “Indonesia” as a search word. 
‘NET Go to Statistics Norway at http://www.ssb.no. What data, if 
any, can you obtain in English? What languages can be used to 
search this Web site? What databases might be of interest to the 
business researcher? 
‘NET Go to Statistics Canada at http://www.statcan.gc.ca. What 
languages can be used to search this Web site? What databases 
might be of interest to the business researcher? 
‘NET Suppose you were working for a company that wanted to 
start a business selling handmade acoustic guitars that are repro- 
ductions of classic vintage guitars. Pricing is a big part of the 
decision. Secondary information is available via the Internet. 
Use eBay (http://ebay.com) to identify four key brands of acous- 
tic guitars by studying the vintage acoustic guitars listed for sale. 
Since the company wishes to charge premium prices, they will 
model after the most expensive brand. What brand seems to be 
associated with the highest prices? 
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Case 8.1 Demand for Gas Guzzlers 
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In fall 2005, Hurricanes Katrina and Rita churn- 
ing in the Gulf of Mexico damaged oil rigs and 
refineries, contributing to a spike in oil prices. 
Many observers expressed confidence that those 
events were the long-expected trigger that would 
kill off demand for SUVs and other gas-guzzling 
vehicles.” They were only partly right. 

In the months leading up to the hurricanes, sales of SUVs 
had already been falling, according to data from Automotive News. 
Automakers had been shifting ad dollars away from these products. 
CNW Market Research said that in August 2005, consumers 
had for the first time placed fuel economy ahead of performance 
when ranking factors for choosing a new vehicle. When gas prices 
approached three dollars a gallon in September 2005, marketers felt 
sure that fuel economy would remain a top concern. Advertisers 
began creating more ads featuring vehicles’ gas mileage. 

But by the end of the year, attitudes were shifting again. The 
National Automobile Dealers Association surveyed consumers 


visiting its Web site for information about car purchases, and it 


learned they ranked price as most important, followed by make and 


model, then performance. Fuel economy ranked last, with 3 percent 


considering it most important and 11 percent considering it least 


important. What’s a carmaker to do? General Motors gathers data 


from the shoppers who visit Web sites such as www.kbb.com to look 


up information, and it is analyzing the data to identify the price of 


fuel at which car buyers adjust their priorities. 


Questions 

1. From the standpoint of an automobile company, what sources 
of information in this article offer secondary data? 

2. Suggest two or three other sources of data that might be of 
interest to auto companies interested in forecasting demand. 

3. Online or at your library, look for information about recent 


trends in SUV purchases. Report what you learned, and fore- 
cast whether SUV sales are likely to recover or continue their 
decline. What role do gas prices play in your forecast? 


CHAPTER 9 
SURVEY RESEARCH: 
AN OVERVIEW 


After studying this chapter, you should be able to 
1. Define surveys and explain their advantages 


2. Describe the type of information that may be gathered 
in a survey 


3. Identify sources of error in survey research 
4. Distinguish among the various categories of surveys 


5. Discuss the importance of survey research to total quality 
management programs 


Chapter Vignette: Media Phones— 
The Next Wave of Communication Technology? 


What's next in the world of electronic communication? In just a few years, we have seen cellular 
phones move from simple devices to talk with someone to portable music and video players 
with the ability to directly download music and movies, as well as watch television. We keep our 
calendars and all our contact information in our cell phones. During this same time, our in-home 
phones have advanced little. That is about to change, according to research conducted by In-Stat 
(http://www.in-stat.com). In-Stat claims to be “the leading provider of actionable research, market 
analysis and forecasts of advanced communications services, infrastructure, end-user devices and 
semiconductors.” 


While you may have never heard the term media phone, you could very well have one in your 
home in the next four years: 


The media phone represents a new category of broadband 
multimedia device that has the potential to become the 4th 
screen in the home, complementing the PC, TV, and mobile 
handset. The media phone delivers direct access to Internet- 
based entertainment and applications using a large (6-10 inch) 
color touchscreen display with a high-quality speakerphone. 
The media phone combines the power of a PC with the 
always-on functionality of the home telephone. Most units are 
configured with one or more cordless DECT voice handsets, 
suitable for any room in the home. 

In-Stat research has found that the most popular consumer 
Internet activities include viewing online information services 
(news updates, weather forecasts, recipes, directory searches), 
and accessing entertainment content (YouTube videos, movie a 
clips, and music). Media phones offer always-on, one-touch access wer 
to this popular media content. Other applications, such as a digital o at. a. 
picture frame, TV electronic program guide, local purchases (e.g., zji Touch Revolution’s NIMble 
pizza or movie tickets) and the integration of mobile features (e.g., platform media phone powered 
visual voice mail, network-based address book, and location-based services) will help make the by Android. 
media phone an indispensable part of every broadband household. [http://www.instat.com/ 
promos/09/dI/media_phone_3ufewaCr.pdf] 
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In-Stat has conducted extensive survey research to learn consumer perceptions, attitudes, and 
desires regarding media phones. The company estimates the consumer market for media phones 
could reach nearly 50 million units and $8 billion in worldwide revenue by 2013. In addition to 
identifying the primary uses of the media phone noted above, In-Stat research determined the 


185 


186 


Part 3: Research Methods for Collecting Primary Data 


characteristics of the product customers desired across consumer age groups and geographic loca- 
tions. For example, U.K. customers place much greater importance on the television component of 
the media phone than French customers. Further, the research shows (perhaps not surprisingly) that 
younger customers have a much higher level of interest in the media phone than older customers. 
Younger customers also planned on putting the media phone in their living room or bedroom, while 
older customers would place it in their home office. Older customers also show a strong preference 
for charging their media phone handsets in a cradle, while younger customers want to plug theirs in 
like a cell phone. 

In-Stat’s survey research obviously has significant benefits for an electronics manufacturer. Not 
only will this research help with product design and development, but with production planning, 
pricing, promotion, and distribution. An investment in this research upfront can save millions of dol- 
lars down the road. In a few years, we may all have a media phone in our home! 


respondents 


People who verbally answer an 
interviewer's questions or provide 
answers to written questions. 


sample survey 


A more formal term for a survey. 


Introduction 


The purpose of survey research is to collect primary data—data gathered and assembled specifically 
for the project at hand. This chapter, the first of two on survey research, defines the subject. It also 
discusses typical research objectives that may be accomplished with surveys and various advantages 
of the survey method. The chapter explains many potential errors that researchers must be careful 
to avoid. Finally, it classifies the various survey research methods. 

Often research entails asking people—called respondents—to provide answers to written or 
spoken questions. These interviews or questionnaires collect data through the mail, on the tele- 
phone, online, or face-to-face. Thus, a survey is defined as a method of collecting primary data 
based on communication with a representative sample of individuals. Surveys provide a snapshot 
at a given point in time. The more formal term, sample survey, emphasizes that the purpose of 
contacting respondents is to obtain a representative sample, or subset, of the target population. 


Using Surveys 


The type of information gathered in a survey varies considerably depending on its objectives. 
Typically, surveys attempt to describe what is happening or to learn the reasons for a particular 
business activity. 

Identifying characteristics of target markets, measuring customer attitudes, and describing 
consumer purchase patterns are all common business research objectives. Most business surveys 
have multiple objectives; few gather only a single type of factual information. In the open- 
ing vignette, In-Stat asked questions about product use and desirable features which can help 
with product development and advertising messages. Geographic, demographic, and media 
exposure information were also collected to help plan a market segmentation strategy. A study 
commissioned by eBay provides another example of the information that can be gleaned from 
survey research. eBay learned that almost 60 percent of respondents receive unwanted gifts, and 
15 percent of them had sold an unwanted gift online, suggesting a possible source of demand for 
eBay’s auction services.” In addition, the survey indicated that selling unwanted gifts online was 
twice as common among 25- to 34-year-olds. Although consumer surveys are a common form 
of business research, not all survey research is conducted with the ultimate consumer. Frequently, 
studies focus on wholesalers, retailers, industrial buyers, or within the organization itself. For 
example, a survey could be used to determine an organization’s commitment to the environ- 
ment. Also, measuring employee job satisfaction and describing the risk aversion of financial 
investors may be important survey objectives. 

Because most survey research is descriptive research, the term survey is most often associated 
with quantitative findings. Although most surveys are conducted to quantify certain factual infor- 
mation, some aspects of surveys may also be qualitative. In new-product development, a survey 
often has a qualitative objective of refining product concepts. Stylistic, aesthetic, or functional 
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Ø this chapter introduces survey 
Ne 3 5 : 
$ research, discussing several dif- 
i ferent types of error and bias 
Y that may be present in survey 
research. Review the online survey 
designed for the business research 
course we are using for this class, then address the 
following questions: 


1. Can you find areas within the survey or survey 
process that may result in error or bias? Identify at 
least three different sources of potential error or 
bias and offer suggestions on how this error can 
be reduced. 

2. How would you classify this survey on the struc- 
tured, disguised, and temporal dimensions? 

3. How could this survey help your academic insti- 
tution implement a total quality management 
program? 


changes may be made on the basis of respondents’ suggestions. In our example of an organiza- 
tion’s environmental attitudes, a survey might be used to gather qualitative information regarding 
activities that could make the company more “green.” 

Evaluating the nature of advertising may also be an objective of survey research, as in the fol- 
lowing story told to advertiser Michael Arlen about testing a rough commercial for AT&T: 


We called it “Fishing Camp.” The idea was this: These guys go off to a fishing camp in the north woods, 
somewhere far away, where they’re going to have a terrific time together and do all this great fishing, only 
what happens is that it rains all the time and the fishing is a bust. Mind you, this was a humorous ad. 
The emphasis was on the humor. Anyway, the big moment occurs when the fishing guys are talking on 
the phone to their jealous friends back home—who naturally want to know how great the fishing is—and 
what you see are the fishing guys, huddled in this cabin, with the rain pouring down outside, and one of 
the guys is staring at a frying pan full of hamburgers sizzling on the stove while he says into the phone, 
“Boy, you should see the great trout we’ve got cooking here.” 


However, much to the advertisers’ astonishment, when they tested the advertisement and gave 
subjects a questionnaire, respondents recalled that what was cooking was trout. To counteract this 
misimpression, said the advertiser, “We ended up making it, but what we had to do was, when 
we came to that segment, we put the camera almost inside the frying pan, and in the frying pan we 
put huge, crude chunks of hamburger that were so raw they were almost red.” 


Advantages of Surveys 


Surveys provide a quick, inexpensive, efficient, and accurate means of assessing information about 
a population. The examples given earlier illustrate that surveys are quite flexible and, when prop- 
erly conducted, extremely valuable to the manager. 

As we discussed in Chapter 1, business research has proliferated in recent years. The growth 
of survey research is related to the simple idea that to find out what someone thinks, you need to 
ask them.* 

Over the last 50 years and particularly during the last two decades, survey research techniques 
and standards have become quite scientific and accurate. When properly conducted, surveys offer 
managers many advantages. However, they can also be used poorly when researchers do not 
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Intuit Gets Answers to Satisfy Customers 
Intuit, maker of Quicken, QuickBooks, and Turbo Tax software 

for accounting and tax preparation, has enjoyed years of growth 
and profits, thanks in part to its efforts to learn what custom- 

ers want. One of its most important marketing research tools is 
called a “net promoter survey.” That survey is extremely simple. 
Researchers simply ask customers, “On a scale of 0 to 10 [with 10 
being most likely], how likely is it that you would recommend our 
product to your friends or colleagues?” Customers who respond 
with a 9 or 10 are called “promoters,” and customers who 
respond with 0 through 6 are called “detractors.” Subtracting the 
percentage of respondents who are detractors from the percent- 
age who are promoters yields the net promoter score. 

Intuit’s CEO, Steve Bennett—who says he believes that “any- 
thing that can be measured can be improved”—encourages the 
ongoing collection of net promoter scores as a way to improve 
products and customer service and thereby build revenues 
and profits. Of course, making improvements requires that the 
company not only know whether customers are satisfied or dis- 
satisfied but also know why. To learn more, the company asks 
survey respondents who are promoters to go online and provide 
more detailed opinions. For example, Intuit learned that claiming 
rebates was an annoying process (the company has simplified 
it) and that discount stores were offering some products for less 
than the prices offered online to frequent buyers (the company 
plans to adjust prices). 

For even more in-depth 
information, Intuit supple- 
ments survey research with 
direct observation of custom- 


ers. One year the company sent hundreds 
of employees, including CEO Bennett, to 
visit customers as they worked at their 
computers. The observers learned that a 
significant number of small-business owners 
were struggling with the accounting know-how 

they needed to use QuickBooks and were mystified by terms 
such as accounts payable and accounts receivable. In response, 
the company introduced QuickBooks: Simple Start Edition, which 
replaces the financial jargon with simple terms like cash in and 
cash out. In the first year after its launch, Simple Start Edition sold 
more copies than any other accounting software except the stan- 
dard QuickBooks. 

This Research Snapshot not only illustrates Intuit’s reliance 
on survey research to enhance products and monitor customer 
satisfaction and loyalty, but also shows the close relationship 
between qualitative and quantitative research. As we discussed 
in Chapter 7, qualitative research is often used in exploratory 
business research to set the stage for quantitative research, 
such as surveys. Qualitative research can also be used to pro- 
vide richer information, to bring the quantitative research 
numbers to life. Intuit recognizes the value of both research 
approaches. 


Sources: Darlin, Damon, “The Only Question That Matters,” Business 2.0 (September 
2005), http://web2.infotrac.galegroup.com; Kirkpatrick, David, “Throw It at the Wall 
and See if It Sticks,” Fortune (December 12, 2005), http://web2.infotrac.galegroup. 
com; and McGregor, Jena, “Would You Recommend Us?” Business Week (January 30, 
2006), http://web5.infotrac.galegroup.com; Reicheld, Frederick F., “The One Number 
You Need to Grow,” Harvard Business Review (December 1, 2003); Reicheld, Frederick 
F., “The One Number You Need to Grow: Key Ideas from the Harvard Business 
Review Article,” HBR in Brief, accessed February 12, 2009. 


follow research principles, such as careful survey and sample design. Sometimes even a well- 


designed and carefully executed survey is not helpful because the results are delivered too late to 


inform decisions. 


The disadvantages of specific forms of survey data collection—personal interview, telephone, 


mail, Internet, and other self-administered formats—are discussed in Chapter 10. However, errors 


are common to all forms of surveys, so it is appropriate to describe them generally. 


Errors in Survey Research 


A manager who is evaluating the quality of a survey must estimate its accuracy. Exhibit 9.1 out- 


lines the various forms of survey error. They have two major sources: random sampling error and 


systematic error. 


Random Sampling Error 


random sampling error 


A statistical fluctuation that 
occurs because of chance varia- 
tion in the elements selected for 
a sample. 
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Most surveys try to portray a representative cross-section of a particular target population. Even 
with technically proper random probability samples, however, statistical errors will occur because of 
chance variation in the elements selected for the sample. These statistical problems are unavoidable 
without very large samples (>400). However, the extent of random sampling error can be estimated. 
Chapters 16 and 17 will discuss these errors and ways they can be estimated in more detail. 
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EXHIBIT 9.1 Categories of Survey Errors 


Systematic Error 


The other major source of survey error, systematic error, results from some imperfect aspect of 
the research design or from a mistake in the execution of the research. Because systematic errors 
include all sources of error other than those introduced by the random sampling procedure, these 
errors or biases are also called nonsampling errors. A sample bias exists when the results of a sample 
show a persistent tendency to deviate in one direction from the true value of the population 
parameter. The many sources of error that in some way systematically influence answers can be 
divided into two general categories: respondent error and administrative error. 


Respondent Error 


Surveys ask people for answers. If people cooperate and give truthful answers, a survey will likely 
accomplish its goal. If these conditions are not met, nonresponse error or response bias, the two 
major categories of respondent error, may cause sample bias. 


NONRESPONSE ERROR 


Few surveys have 100 percent response rates. In fact, surveys with relatively low response rates may 
still accurately reflect the population of interest. However, a researcher who obtains a 1 percent 
response to a five-page e-mail questionnaire concerning various brands of spark plugs may face a 
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systematic error 


Error resulting from some imper- 
fect aspect of the research design 
that causes respondent error or 
from a mistake in the execution 
of the research. 


sample bias 


A persistent tendency for the 
results of a sample to deviate in 
one direction from the true value 
of the population parameter. 


respondent error 


A category of sample bias result- 
ing from some respondent action 
or inaction such as nonresponse 
or response bias. 
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Overestimating Patient Satisfaction 
When companies conduct surveys to learn about customer 
satisfaction, they face an important challenge: do the responses 
represent a cross-section of customers? Maybe just the hap- 
piest or most angry customers participate. This problem also 
occurs when the “customers” are the patients of a health-care 
provider. 

To investigate this issue, a group of researchers in Massachusetts 
studied data from patient satisfaction surveys that rated 
6,681 patients’ experiences with 82 primary-care physicians 
(internists and family practitioners) at a health maintenance 
organization. These ratings represented response rates ranging 
from 11 to 55 percent, depending on the physician being rated. 
The researchers compared their information about response 
rates with a set of simulated 
data for which they knew the 
underlying distribution of 
responses. They found that 


the actual data closely matched simulated 
data in which responses were biased so that 
responses were more likely when satisfac- 
tion was higher. 

The researchers concluded that there 
was a significant correlation between the 
response rate and average (mean) satisfaction rating. In other 
words, more-satisfied patients were more likely to complete and 
return the survey. Thus, if the HMO were to use the data to evalu- 
ate how satisfied patients are with their doctors, it would overes- 
timate satisfaction. Also, it would have less information about its 
lower-performing doctors. The researchers therefore concluded 
that it is important to follow up with subjects to encourage 
greater response from less-satisfied patients. 


Source: Based on Mazor, Kathleen M., Brian E. Clauser, Terry Field, Robert A. Yood, 
and Jerry H. Gurwitz, “A Demonstration of the Impact of Response Bias on the 
Results of Patient Satisfaction Surveys,” Health Services Research (October 2002), 
downloaded from http://galenet.galegroup.com. 
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serious problem. To use the results, the researcher must believe that consumers who responded to 


the questionnaire are representative of all consumers, including those who did not respond. The 


statistical differences between a survey that includes only those who responded and a survey that 


nonresponse error 


The statistical differences 
between a survey that includes 
only those who responded and 

a perfect survey that would 
also include those who failed to 
respond. 


to-face interviews. 


also included those who failed to respond are referred to as nonresponse error. This problem is 
especially acute in mail and Internet surveys, but nonresponse also threatens telephone and face- 


People who are not contacted or who refuse to cooperate are called nonrespondents. A non- 
response occurs if no one answers the phone at the time of both the initial call and any subsequent 
callbacks. The number of no contacts in telephone survey research has been increasing because of 


the proliferation of answering machines and growing use of caller ID to screen telephone calls.’ 


nonrespondents 


People who are not contacted or 
who refuse to cooperate in the 
research. 


no contacts 


be polite. 


People who are not at home or 
who are otherwise inaccessible 
on the first and second contact. 


refusals 


People who are unwilling to par- 
ticipate in a research project. 


The respondent who is not at home when called or visited should be scheduled to be interviewed 
at a different time of day or on a different day of the week. Refusals occur when people are unwill- 
ing to participate in the research. A parent who must juggle the telephone and a half-diapered 
child and refuses to participate in the survey because he or she is too busy also is a nonresponse. 
After receiving a refusal from a potential respondent, an interviewer can do nothing other than 


A research team reviewed 50 mail surveys of pediatricians conducted by the American 
Academy of Pediatrics (AAP) between 1994 and 2002 and found that response rates declined 
over the period studied. In the early years of the study period, an average 70 percent of pediatri- 
cians returned completed surveys; the response rate fell to an average 63 percent in the second 
half of the period. No contacts and refusals can seriously bias survey data. In the case of the 


pediatricians, the researchers found little difference in the response rates attributable to differ- 


ences in such easy-to-measure variables as age, sex, and type of membership in the AAP, leav- 


ing them to wonder whether the cause of refusals was some unknown but important difference 


among these doctors. 


Because of this problem, researchers investigate the causes of nonresponse. For example, a 


study analyzed a large database collected by AT&T and found that the effort required to partici- 


pate in an ongoing study contributes to the problem.” People tend not to respond to questions 


that are difficult to answer. When they are asked to participate in a long-term panel, the rate of 


nonresponse to individual items grows over time, and eventually some people stop participating 


altogether. However, eventually it becomes easier to keep answering the same kinds of panel 


questions, and nonresponse rates level off. 
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With a mail survey, the researcher never really knows 
whether a nonrespondent actually received the survey, has 
refused to participate, or is just indifferent. Researchers know 
that those who are most involved in an issue are more likely 
to respond to a mail survey. Self-selection bias is a problem 
that frequently plagues self-administered questionnaires. In a 
restaurant, for example, a customer on whom a waiter spilled 
soup, a person who was treated to a surprise dinner, or oth- 
ers who feel strongly about the service are more likely to 
complete a self-administered questionnaire left at the table 
than individuals who are indifferent about the restaurant. 
Self-selection biases distort surveys because they overrep- 
resent extreme positions while underrepresenting responses 
from those who are indifferent. Several techniques will be 
discussed later for encouraging respondents to reply to mail 
and Internet surveys. 

Comparing the demographics of the sample with the demo- 
graphics of the target population is one means of inspecting for 
possible biases in response patterns. If a particular group, such 
as older citizens, is underrepresented or if any potential biases 
appear in a response pattern, additional efforts should be made to 
obtain data from the underrepresented segments of the popula- 
tion. For example, telephone surveys may be used instead of mail surveys or personal interviews 
may be used instead of telephone interviews in an attempt to increase participation of underrep- 
resented segments. 


RESPONSE BIAS 


A response bias occurs when respondents tend to answer questions with a certain slant. People 
may consciously or unconsciously misrepresent the truth. If a distortion of measurement occurs 
because respondents’ answers are falsified or misrepresented, either intentionally or inadvertently, 
the resulting sample bias will be a response bias. When researchers identify response bias, they 
should include a corrective measure. 


Deliberate Falsification 

Occasionally people deliberately give false answers. It is difficult to assess why people knowingly 
misrepresent answers. A response bias may occur when people misrepresent answers to appear 
intelligent, conceal personal information, avoid embarrassment, and so on. For example, respon- 
dents may be able to remember the total amount of money spent grocery shopping, but they may 
forget the exact prices of individual items that they purchased. Rather than appear ignorant or 
unconcerned about prices, they may provide their best estimate and not tell the truth—namely, 
that they cannot remember. Sometimes respondents become bored with the interview and pro- 
vide answers just to get rid of the interviewer. At other times respondents try to appear well 
informed by providing the answers they think are expected of them. On still other occasions, they 
give answers simply to please the interviewer. 

One explanation for conscious and deliberate misrepresentation of facts is the so-called 
average-person hypothesis. Individuals may prefer to be viewed as average, so they alter their 
responses to conform more closely to their perception of the average person. Average-person 
effects have been found in response to questions about such topics as savings account balances, 
car prices, voting behavior, and hospital stays. 


Unconscious Misrepresentation 

Even when a respondent is consciously trying to be truthful and cooperative, response bias can 
arise from the question format, the question content, or some other stimulus. For example, bias 
can be introduced by the situation in which the survey is administered. The results of two in-flight 
surveys concerning aircraft preference illustrate this point. Passengers flying on B-747s preferred 
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Many e-mail addresses are 
actually inactive. Inactive 
e-mails contribute to low 
response rates. 


self-selection bias 


A bias that occurs because 
people who feel strongly about 
a subject are more likely to 
respond to survey questions 
than people who feel indifferent 
about it. 


response bias 


A bias that occurs when respon- 
dents either consciously or 
unconsciously tend to answer 
questions with a certain slant 
that misrepresents the truth. 
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acquiescence bias 


A tendency for respondents to 
agree with all or most questions 
asked of them in a survey. 
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B-747s to L-1011s (74 percent versus 19 percent), while passengers flying on L-1011s preferred 
L-1011s to B-747s (56 percent versus 38 percent). Managers may be tempted to conclude that 
the results demonstrate a preference for B-747s over L-1011s. But perhaps respondents were 
influenced by other factors besides the airplane or had not experience flying in the other type of 
plane. Respondents’ satisfaction scores may simply be a simple response to their overall satisfaction 
with the flying experience. Also, airlines have fleets that consist predominantly of one brand of 
aircraft. Thus, the data appearing to support Boeing may really be showing greater satisfaction for 
the airlines that happen to be flying Boeing and would have higher satisfaction no matter what 
planes were in their fleet." 

Respondents who misunderstand questions may unconsciously provide biased answers. Or 
they may be willing to answer but unable to do so because they have forgotten the exact details. 
Asking “When was the last time you attended a concert?” may result in a best-guess estimate 
because the respondent has forgotten the exact date. 

A bias may also occur when a respondent has not thought about an unexpected question. 
Many respondents will answer questions even though they have given them little thought. For 
example, in most investigations of consumers’ buying intentions, the predictability of the inten- 
tion scales depends on how close the subject is to making a purchase. The intentions of subjects 
who have little knowledge of the brand or the store alternatives being surveyed and the intentions 
of subjects who have not yet made any purchase plans cannot be expected to predict purchase 
behavior accurately. 

In many cases consumers cannot adequately express their feelings in words. The cause may 
be questions that are vague or ambiguous. Researchers may ask someone to describe his or her 
frustration when using a computer. The problem is, the researcher may be interested in software 
problems while the respondent is thinking of hardware issues. Language differences also may be 
a source of misunderstanding. A survey in the Philippines found that, despite seemingly high 
toothpaste usage, only a tiny percentage of people responded positively when asked, “Do you use 
toothpaste?” As it turned out, people in the Philippines tend to refer to toothpaste by using the 
brand name Colgate. When researchers returned and asked, “Do you use Colgate?” the positive 
response rate soared. 

As the time following a purchase or a shopping event increases, people become more likely 
to underreport information about that event. Time lapse influences people’s ability to precisely 
remember and communicate specific factors. 

Unconscious misrepresentation bias may also occur because consumers unconsciously avoid 
facing the realities of a future buying situation. Housing surveys record that Americans over- 
whelmingly continue to aspire to own detached, single-family dwellings (preferably single-level, 
ranch-type structures that require two to five times the amount of land per unit required for 
apartments). However, builders know that apartment (condo) purchases by first buyers are more 
common than respondents report, despite their aspirations. 


Types of Response Bias 

Response bias falls into four specific categories: acquiescence bias, extremity bias, interviewer bias, 
and social desirability bias. These categories overlap and are not mutually exclusive. A single biased 
answer may be distorted for many complex reasons, some distortions being deliberate and some 
being unconscious misrepresentations. 


Acquiescence Bias. Some respondents are very agreeable. They seem to agree to practically 
every statement they are asked about. A tendency to agree (or disagree) with all or most 
questions is known as acquiescence bias. This bias is particularly prominent in new-product 
research. Questions about a new-product idea generally elicit some acquiescence bias because 
respondents give positive connotations to most new ideas. For example, consumers responded 
favorably to survey questions about pump baseball gloves (the pump inserts air into the pocket 
of the glove, providing more cushioning). However, when these expensive gloves hit the 
market, they sat on the shelves. When conducting new-product research, researchers should 
recognize the high likelihood of acquiescence bias. 
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Agreement or disagreement can also be influenced by a respondents feelings toward the organi- 
zation identified as conducting or sponsoring the research. Auspices bias occurs when answers reflect 
the person’s liking or disliking of the sponsor organization rather than simply the relevant opinions. 


Extremity Bias. Some individuals tend to use extremes when responding to questions. For exam- 
ple, they may choose only “1” or “10” on a ten-point scale. Others consistently refuse to use 
extreme positions and tend to respond more neutrally—‘‘T never give a 10 because nothing is really 
perfect.” Response styles vary from person to person, and extreme responses may cause an extremity 
bias in the data.” 


Interviewer Bias. Response bias may arise from the interplay between interviewer and respon- 
dent. If the interviewer’s presence influences respondents to give untrue or modified answers, 
the survey will be marred by interviewer bias. Many homemakers and retired people welcome an 
interviewer’s visit as a break in routine activities. Other respondents may give answers they believe 
will please the interviewer rather than the truthful responses. Respondents may wish to appear 
intelligent and wealthy—of course they read Scientific American rather than Playboy! 

The interviewer’s age, sex, style of dress, tone of voice, facial expressions, or other non- 
verbal characteristics may have some influence on a respondent’s answers. If an interviewer 
smiles and makes a positive statement after a respondent’s answers, the respondent will be 
more likely to give similar responses. In a research study on sexual harassment against sales- 
women, male interviewers might not yield as candid responses from saleswomen as female 
interviewers would. 

Many interviewers, contrary to instructions, shorten or rephrase questions to suit their needs. 
This potential influence on responses can be avoided to some extent if interviewers receive train- 
ing and supervision that emphasize the necessity of appearing neutral. 

If interviews go on too long, respondents may feel that time is being wasted. They may answer 
as abruptly as possible with little forethought. 


Social Desirability Bias. Social desirability bias may occur either consciously or unconsciously 
because the respondent wishes to create a favorable impression or save face in the presence of an 
interviewer. Incomes may be inflated, education overstated, or perceived respectable answers given 
to gain prestige. In contrast, answers to questions that seek factual information or responses about 
matters of public knowledge (zip code, number of children, and so on) usually are quite accurate. 
An interviewer’s presence may increase a respondent’s tendency to give inaccurate answers to sen- 
sitive questions such as “Did you 
vote in the last election?” or “Do 
you have termites or roaches in 
your home?” or “Do you color 
your hair?” 

Social desirability bias is 
especially significant in the case 
of research that addresses sensi- 
tive or personal topics, includ- 
ing respondents’ sexual behavior. 
A group of researchers recently 
evaluated responses to questions 
about homosexual sexual activ- 
ity, collected by the National 
Opinion Research Center’s long- 
running General Social Survey.'° 
The researchers found that over 
time, as attitudes toward homo- 
sexual conduct have softened, the 
frequency of repeated female- 
female sexual contacts increased 
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extremity bias 


A category of response bias that 
results because some individu- 
als tend to use extremes when 
responding to questions. 


interviewer bias 


A response bias that occurs 
because the presence of the 
interviewer influences respon- 
dents’ answers. 


social desirability bias 


Bias in responses caused by 
respondents’ desire, either con- 
scious or unconscious, to gain 
prestige or appear in a different 
social role. 


The more people are 
susceptible to interpersonal 
influence, the more likely a 
response bias will occur. One 
example of this can be found in 
adolescents’ buying behavior. 
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administrative error 


An error caused by the improper 
administration or execution of 
the research task. 


data-processing error 


A category of administrative error 
that occurs because of incorrect 
data entry, incorrect computer 
programming, or other proce- 
dural errors during data analysis. 


sample selection error 


An administrative error caused by 
improper sample design or sam- 
pling procedure execution. 


interviewer error 


Mistakes made by interviewers 
failing to record survey responses 
correctly. 


interviewer cheating 


The practice of filling in fake 
answers or falsifying question- 
naires while working as an 
interviewer. 


One problem with Web-based 
surveys is that there is no 

way of knowing who exactly 
responded to the questionnaire. 


—_ 
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dramatically, suggesting the possibility that reporting levels have been subject to social desirability 
bias. However, the researchers noted that rates of male-male sexual contact were fairly steady 
over the period and that the rate of change for female-female sexual contact persisted even when 
adjusted for measures of greater tolerance. This evidence suggests that the data reflect more phe- 
nomena than mere social desirability bias. 


Administrative Error 


The result of improper administration or execution of the research task is called an administra- 
tive error. Administrative errors are caused by carelessness, confusion, neglect, omission, or some 
other blunder. Four types of administrative error are data-processing error, sample selection error, 
interviewer error, and interviewer cheating. 


DATA-PROCESSING ERROR 


Processing data by computer, like any arithmetic or procedural process, is subject to error 
because data must be edited, coded, and entered into the computer by people. The accuracy of 
data processed by computer depends on correct data entry and programming. Data-processing 
error can be minimized by establishing careful procedures for verifying each step in the data- 
processing stage. 


SAMPLE SELECTION ERROR 


Many kinds of error involve failure to select a representative sample. Sample selection error is sys- 
tematic error that results in an unrepresentative sample because of an error in either the sample 
design or the execution of the sampling procedure. Executing a sampling plan free of procedural 
error is difficult. A firm that selects its sample from the phone book will have some systematic 
error, because those with only cell phones or with unlisted numbers are not included. Stopping 
respondents during daytime hours in shopping centers largely excludes working people or those 
who primarily shop by mail, Internet, or telephone. In other cases, researchers interview the 
wrong person. Consider a political pollster who uses random-digit dialing to select a sample, rather 
than a list of registered voters. Unregistered 17-year-olds may be willing to give their opinions, 
but they are the wrong people to ask because they cannot vote. 


i INTERVIEWER 
ERROR 


Interviewers’ abilities vary consid- 
erably. Interviewer error is intro- 
duced when interviewers record 
answers but check the wrong 
response or are unable to write 
fast enough to record answers ver- 
batim. Also, selective perception 
may cause interviewers to misre- 
cord data that do not support their 
own attitudes and opinions. 


INTERVIEWER 
CHEATING 
Interviewer cheating occurs 
when an interviewer falsifies 


entire questionnaires or fills in 
answers to questions that have 


Chapter 9: Survey Research: An Overview 


been intentionally skipped. Some interviewers cheat to finish an interview as quickly as pos- 
sible or to avoid questions about sensitive topics. Often interviewers are paid by the completed 
survey, so you can see the motivation to complete a survey that is left with some questions 
unanswered. 

If interviewers are suspected of faking questionnaires, they should be told that a small per- 
centage of respondents will be called back to confirm whether the initial interview was actually 
conducted. This practice should discourage interviewers from cheating. The term curb-stoning 
is sometimes used to refer to interviewers filling in responses for respondents that do not really 
exist. 


Rule-of-Thumb Estimates for Systematic Error 


The techniques for estimating systematic, or nonsampling, error are less precise than many 
sample statistics. Researchers have established conservative rules of thumb based on experience 
to estimate systematic error. In the case of consumer research, experienced researchers might 
determine that only a certain percentage of people who say they will definitely buy a new prod- 
uct actually do so. Evidence for a mere-measurement effect (see the Research Snapshot on the 
next page) suggests that in some situations, researchers might conclude that respondents’ own 
buying behavior will exaggerate overall sales. Thus, researchers often present actual survey find- 
ings and their interpretations of estimated purchase response based on estimates of nonsampling 
error. For example, one pay-per-view cable TV company surveys geographic areas it plans to 
enter and estimates the number of people who indicate they will subscribe to its service. The 
company knocks down the percentage by a “ballpark 10 percent” because experience in other 
geographic areas has indicated that there is a systematic upward bias of 10 percent on this inten- 
tions question. 


What Can Be Done to Reduce Survey Error? 


Now that we have examined the sources of error in surveys, you may have lost some of your 
optimism about survey research. Don’t be discouraged! The discussion emphasized the bad news 
because it is important for managers to realize that surveys are not a panacea. There are, however, 
ways to handle and reduce survey errors. For example, Chapter 15 on questionnaire design dis- 
cusses the reduction of response bias; Chapters 16 and 17 discuss the reduction of sample selection 
and random sampling error. Indeed, much of the remainder of this book discusses various tech- 
niques for reducing bias in business research. The good news lies ahead! 


Classifying Survey Research Methods 


Now that we have introduced some advantages and disadvantages of surveys in general, we turn 
to a discussion of classification of surveys according to several criteria. Surveys may be classified 
based on the method of communication, the degrees of structure and disguise in the question- 
naire, and the time frame in which the data are gathered (temporal classification). Chapter 10 
classifies surveys according to method of communicating with the respondent, covering topics 
such as personal interviews, telephone interviews, mail surveys, and Internet surveys. The clas- 
sifications based on structure and disguise and on time frame will be discussed in the remainder 


of this chapter. 


Structured/Unstructured and Disguised/ 
Undisguised Questionnaires 
In designing a questionnaire (or an interview schedule), the researcher must decide how much struc- 


ture or standardization is needed.'' A structured question limits the number of allowable responses. 
For example, the respondent may be instructed to choose one alternative response such as “under 


structured question 
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A question that imposes a limit 
on the number of allowable 
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The “Mere-Measurement” Effect 
Will you eat high-fat food this week? Will you floss your teeth? 
Researchers have found that answering survey questions like 
these can actually shift your behavior. This influence, called 
the mere-measurement effect, means that simply answering 
a question about intentions will increase the likelihood of the 


underlying behavior—if the behavior is seen as socially desirable. 


If the behavior is considered 
undesirable, answering the 
question tends to decrease 


behaviors. However, the mere-measurement 
effect did not occur if the surveys indicated 
that they were sponsored by groups that 
would be likely to want to persuade the 
subjects (in this case, the American Fruit 
Growers Association and the Association of 
Dental Products Manufacturers). In fact, subjects decreased their 
frequency of flossing if they took the supposedly manipulative 
survey that asked about flossing. Follow-up experiments verified 
that changes to behavior were genuine, not merely a survey bias. 


unstructured question 


A question that does not restrict 
the respondents’ answers. 


undisguised questions 


Straightforward questions that 
assume the respondent is willing 
to answer. 


disguised questions 


Indirect questions that assume 
the purpose of the study must be 
hidden from the respondent. 


cross-sectional study 


A study in which various seg- 
ments of a population are sam- 
pled and data are collected at a 

single moment in time. 
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The researchers propose that the mere-measurement effect 
occurs because subjects of a survey generally do not think the 
questions are an attempt to persuade them. If they receive 
information that puts them on their guard against persuasion, 
the mere-measurement effect is lessened and sometimes even 
generates the opposite behavior. Their results suggest a need 
for caution when surveys attempt to predict future behavior. 


the likelihood of the behavior. 
To test this, a group of 
business school professors 
conducted a series of surveys 
in which certain subjects were 
asked about their intentions 
to eat fatty food or to floss. In 
follow-up surveys, they found 
that subjects ate less fatty 
food and flossed more often if 
they were asked about those 


Source: Williams, Patti, Gavan J. Fitzsimons, Lauren G. Block, “When Consumers Do 
Not Recognize ‘Benign’ Intention Questions as Persuasion Attempts,” © 2004 by 
Journal of Consumer Research, Inc. 31 (December 2004). All rights reserved. Reprinted 
with permission by the University of Chicago Press. 


18,” “18-35,” or “over 35” to indicate his or her age. An unstructured question does not restrict 
the respondent’s answers. An open-ended, unstructured question such as “Why do you shop at 
Wal-Mart?” allows the respondent considerable freedom in answering. 

The researcher must also decide whether to use undisguised questions or disguised questions. 
A straightforward, or undisguised, question such as “Do you have dandruff problems?” assumes 
that the respondent is willing to reveal the information. However, researchers know that some 
questions are threatening to a person’s ego, prestige, or self-concept. So, they have designed a 
number of indirect techniques of questioning to disguise the purpose of the study. 

Questionnaires can be categorized by their degree of structure and degree of disguise. For 
example, interviews in exploratory research might use unstructured-disguised questionnaires. The 
projective techniques discussed in Chapter 7 fall into this category. Other classifications are struc- 
tured-undisguised, unstructured-undisguised, and _structured-disguised. These classifications have two 
limitations: First, the degree of structure and the degree of disguise vary; they are not clear-cut 
categories. Second, most surveys are hybrids, asking both structured and unstructured questions. 
Recognizing the degrees of structure and disguise necessary to meet survey objectives will help in 
the selection of the appropriate communication medium for conducting the survey. 


Temporal Classification 


Although most surveys are for individual research projects conducted only once over a short time 
period, other projects require multiple surveys over a long period. Thus, surveys can be classified 
on a temporal basis. 


CROSS-SECTIONAL STUDIES 


Do you make New Year’s resolutions? A Harris Interactive survey conducted in November 2008 
indicates that women (74 percent) are more likely than men (58 percent) to actually make a New 
Year’s resolution. However, more men than women “always or often keep their resolutions” 
(22 percent of men compared to 14 percent of women). This was a cross-sectional study because 
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it collected the data at a single point in time. That is, the survey asked people to reflect on their 
past behavior, rather than ask them if they made a resolution, then follow up a year later to see if 
the resolution was kept. Such a study samples various segments of the population to investigate 
relationships among variables by cross-tabulation. Most business research surveys fall into this cat- 
egory. We can think of cross-sectional studies as taking a snapshot of the current situation. 

The typical method of analyzing a cross-sectional survey is to divide the sample into appropri- 
ate subgroups. For example, if a winery expects income levels to influence attitudes toward wines, 
the data are broken down into subgroups based on income and analyzed to reveal similarities or 
differences among the income subgroups. If a manager thinks that length of time an employee 
has been with the organization will influence their attitudes toward corporate policies, employ- 
ees might be broken into different groups based on tenure (e.g., less than 5 years, 5—9 years, 
10—14 years, and 15 years or more) so their attitudes can be examined. 


LONGITUDINAL STUDIES 


In a longitudinal study respondents are questioned at multiple points in time. The purpose of lon- 
gitudinal studies is to examine continuity of response and to observe changes that occur over time. 
Many syndicated polling services, such as Gallup, conduct regular polls. For example, the Bureau 
of Labor Statistics conducts the National Longitudinal Survey of Youth, interviewing the same 
sample of individuals repeatedly since 1979. (Respondents, who were “youth” at the beginning of 
the study, are now in their 40s.) Research scientist Jay Zagorsky recently analyzed the longitudinal 
data from that study to determine that those who married and stayed with their spouse accumu- 
lated almost twice as much wealth as single and divorced people in the study. The Yankelovich 
MONITOR has been tracking American values and attitudes for more than 30 years. This survey 
is an example of a longitudinal study that uses successive samples; its researchers survey several 
different samples at different times. Longitudinal studies of this type are sometimes called cohort 
studies, because similar groups of people who share a certain experience during the same time 
interval (cohorts) are expected to be included in each sample. Exhibit 9.2 illustrates the results of 
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Do you tend to feel 
Most people with power 
try to take advantage of 
people like yourself. 
The people running the 
country don't really care 
what happens to you. 
You're left out of things 
going on around you 


Æ 2005 © 2000 W 1995 Œ 1990 


Source: “Americans Feel More Isolated, Less Empowered, Poll Shows,” Wall Street Journal (December 8, 2005), http://online 
wsj.com. 
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Time is but the stream 
I go a-fishing in. 


—Henry David Thoreau 


longitudinal study 


A survey of respondents at differ- 
ent times, thus allowing analysis 
of response continuity and 
changes over time. 


EXHIBIT 9.2 
Longitudinal Research from 
a Harris Poll 
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tracking study 


A type of longitudinal study that 
uses successive samples to com- 
pare trends and identify changes 
in variables such as consumer 
satisfaction, brand image, or 
advertising awareness. 


consumer panel 


A longitudinal survey of the same 
sample of individuals or house- 
holds to record their attitudes, 
behavior, or purchasing habits 
over time. 


total quality management 


A business philosophy that 
emphasizes market-driven quality 
as a top organizational priority. 
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a longitudinal study by Harris Interactive, which since 1966 has been asking five questions related 
to powerlessness and isolation to create an “alienation index.” We can think of longitudinal studies 
as taking a movie of an evolving situation. 

In applied business research, a longitudinal study that uses successive samples is called a 
tracking study because successive waves are designed to compare trends and identify changes in vari- 
ables such as consumer satisfaction, brand image, or advertising awareness. These studies are useful 
for assessing aggregate trends but do not allow for tracking changes in individuals over time. 

Conducting surveys in waves with two or more sample groups avoids the problem of response 
bias resulting from a prior interview. A respondent who was interviewed in an earlier survey about 
a certain brand may become more aware of the brand or pay more attention to its advertising after 
being interviewed. Using different samples eliminates this problem. However, researchers can 
never be sure whether the changes in the variable being measured are due to a different sample or 
to an actual change in the variable over time. 


Consumer Panel 

A longitudinal study that gathers data from the same sample of individuals or households over 
time is called a consumer panel. Consider the packaged-goods marketer that wishes to learn 
about brand-switching behavior. A consumer panel that consists of a group of people who record 
their purchasing habits in a diary over time will provide the manager with a continuous stream 
of information about the brand and product class. Diary data that are recorded regularly over an 
extended period enable the researcher to track repeat-purchase behavior and changes in pur- 
chasing habits that occur in response to changes in price, special promotions, or other aspects of 
business strategy. 

Panel members may be contacted by telephone, in a personal interview, by mail question- 
naire, or by e-mail. Typically respondents complete media exposure or purchase diaries and mail 
them back to the survey organization. If the panel members have agreed to field test new products, 
face-to-face or telephone interviews may be required. The nature of the problem dictates which 
communication method to use. 

Because establishing and maintaining a panel is expensive, panels often are managed by con- 
tractors who offer their services to many organizations. A number of commercial firms, such as 
National Family Opinion (NFO), Inc., Market Research Corporation of America, and Consumer 
Mail Panels, Inc., specialize in maintaining consumer panels. In recent years Internet panels have 
grown in popularity. Because clients of these firms need to share the expenses with other clients 
to acquire longitudinal data at a reasonable cost, panel members may be asked questions about a 
number of different issues. 

The first questionnaire a panel member is asked to complete typically includes questions about 
product ownership, product usage, pets, family members, and demographic data. The purpose of 
such a questionnaire is to gather the behavioral and demographic data that will be used to identify 
heavy buyers, difficult-to-reach customers, and so on for future surveys. Individuals who serve as 
members of consumer panels usually are compensated with cash, attractive gifts, or the chance to 
win a sweepstakes. 

Marketers whose products are purchased by few households find panels an economical means 
of reaching respondents who own their products. A two-stage process typically is used. A panel 
composed of around 15,000 households can be screened with a one-question statement attached to 
another project. For example, a question in an NFO questionnaire screens for ownership of certain 
uncommon products, such as snowmobiles and motorcycles. This information is stored in a data- 
base. Then households with the unusual item can be sampled again with a longer questionnaire. 


Total Quality Management and 
Customer Satisfaction Surveys 


Total quality management is a business strategy that emphasizes market-driven quality as a top pri- 
ority. Total quality management involves implementing and adjusting the firm’s business activities 
to assure customers’ satisfaction with the quality of goods and services. 


I Fairfax Library’s Survey services, and how satisfied they are. Answers help the library cor- 


= “ for Satisfaction rect problems and set budget priorities. 

Not only do businesses use research, but In a recent telephone survey, the library called a sample of 
not-for-profits often engage in research activities community members to investigate whether changes it had 
as well. For instance, the Fairfax (Virginia) County made to its information services had affected use of the library. 

Public Library (FCPL) uses surveys to gather data and improve Answers to 33 questions 

the satisfaction of library users and the community at large—the helped the library pinpoint 

taxpayers who pay the library’s bills. Like most libraries, FCPL what services were being 

has long gathered usage data such as circulation statistics and used and what attitudes they 

number of patrons who visit each day, but it has more recently held toward the library. FCPL’s 

focused on outcomes including satisfaction with specific services librarians were pleased to 

and the library overall. learn that even nonusers of 
Every spring, FCPL posts a ten-question survey on its Web the library viewed it as a valu- 


site. This Web Site User Survey asks users how easy the site is to able part of the community. 

navigate, what additional online services they would like, and source Based on Clay, Edwin S iland 

whether they are satisfied with the Web site. Periodically, the Patricia Bangs, “Beyond Numbers,” 

library conducts face-to-face and telephone surveys of library Library Journal (January 1, 2006), 
ER 5 A http://www.galenet.com. 

users. These surveys gather descriptive information about visitors 

and ask what services they use, how aware they are of particular 
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Many U.S. organizations adopted total quality management in the 1980s when an increase in 
high-quality foreign competition challenged their former dominance. Today companies continue 
to recognize the need for total quality management programs. Executives and production workers 
are sometimes too far removed from the customer. Companies need a means to bridge this gap 
with feedback about quality of goods and services. This means conducting research. In an organi- 
zation driven by the quality concept, business research plays an important role in the management 
of total product quality. 


What Is Quality? 


Organizations used to define quality by engineering standards. Most companies no longer see 
quality that way. Some managers say that having a quality product means that the good or service 
conforms to consumers’ requirements and that the product is acceptable. Effective executives who 
subscribe to a total quality management philosophy, however, believe that the product’s quality 
must go beyond acceptability for a given price range. Rather than merely being relieved that 
nothing went wrong, consumers should experience some delightful surprises or reap some unex- 
pected benefits. In other words, quality assurance is more than just meeting minimum standards. 
The level of quality is the degree to which a good or service truly is seen as good or bad. 

Obviously, a BMW 750i does not compete directly with a Kia Spectra. Buyers of these auto- 
mobiles are in different market segments, and their expectations of quality differ widely. Never- 
theless, managers at BMW and Kia both try to establish the quality that is acceptable given the 
cost of ownership. 


Internal and External Customers 


Organizations that have adopted the total quality management philosophy believe that a focus on 
customers must include more than external customers. Like Arbor, Inc., they believe that every- 
one in the organization has customers: 


Every person, in every department, and at every level, has a customer. The customer is anyone to whom 
an individual provides service, information, support, or product. The customer may be another employee 
or department (internal) or outside the company (external).'* 
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Total quality management programs work most effectively when every employee knows 
exactly who his or her customers are and what output internal and external customers expect. 
Also, it is important to know how customers perceive their needs are being met. All too often 
differences between perceptions and reality are not understood. 


Implementing Total Quality Management 


Implementing a total quality management program requires considerable survey research. A firm 
must routinely ask customers to rate it against its competitors. It must periodically measure employee 
knowledge, attitudes, and expectations. It must monitor company performance against benchmark 
standards. It must determine whether customers found any delightful surprises or major disappoint- 
ments. In other words, a total quality management strategy expresses the conviction that to improve 
quality, an organization must regularly conduct surveys to evaluate quality improvement. 

Exhibit 9.3 illustrates the total quality management process. The exhibit shows that overall 
tracking of quality improvement requires longitudinal research. The process begins with a com- 
mitment and exploration stage, during which management makes a commitment to total quality 


EXHIBIT 9.3 Longitudinal Research for Total Quality Management 
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assurance and researchers explore external and internal customers’ needs and beliefs. The research 
must discover what product features customers value, what problems customers are having with 
the product, what aspects of product operation or customer service have disappointed customers, 
what the company is doing right, and what the company may be doing wrong. 

After internal and external customers’ problems and desires have been identified, the bench- 
marking stage begins. Research must establish quantitative measures that can serve as benchmarks 
or points of comparison against which to evaluate future efforts. The surveys must establish initial 
measures of overall satisfaction, of the frequency of customer problems, and of quality ratings for 
specific attributes. Researchers must identify the company’s or brand’s position relative to com- 
petitors’ quality positions. For example, when Anthony Balzarini became food-service manager 
at Empire Health Services in Spokane, Washington, he became responsible for serving meals to 
the patients of the company’s two hospitals, plus retail food service (sales to visitors and employ- 
ees who eat in the hospitals). He began tracking quality according to several measures, including 
satisfaction scores on patient surveys and sales volume and revenue on the retail side. Sales mea- 
surements include comparing the average sale with other locations, including restaurants, in the 
Spokane area." 

The initial quality improvement stage establishes a quality improvement process within the orga- 
nization. Management and employees must translate quality issues into the internal vocabulary 
of the organization. The company must establish performance standards and expectations for 
improvement. For Balzarini, this stage included training food-service employees in providing 
patient service. He began holding meetings twice daily to identify any problems to be resolved. 
Managers were each assigned to one floor of the hospital and charged with building a close work- 
ing relationship with the nursing staff there. They are expected to visit their floor every week and 
conduct 15 interviews with patients to learn about what they like and dislike. On the retail side, 
the manager is expected to revise menus every 12 weeks to offer more variety. Waste is literally 
weighed and categorized to identify which types of food are rejected by patients and customers. 

After managers and employees have set quality objectives and implemented procedures and 
standards, the firm continues to track satisfaction and quality ratings in successive waves. The pur- 
pose of tracking wave 1 is to measure trends in satisfaction and quality ratings. Business researchers 
determine whether the organization is meeting customer needs as specified by quantitative stan- 
dards. At one of Empire’s two hospitals, one of the food-service managers learned that a patient 
on a liquid diet disliked the broth he was being served. An investigation showed that the recipe 
had been changed, and a taste test confirmed that the original recipe was superior, so the hospital 
switched back to the original recipe. 

The next stage, continuous quality improvement, consists of many consecutive waves with the 
same purpose—to improve over the previous period. Continuous quality improvement requires 
that management allow employees to initiate problem solving without a lot of red tape. Employ- 
ees should be able to initiate proactive communications with consumers. In tracking wave 2, 
management compares results with those of earlier stages. Quality improvement management 
continues. At Empire, improvements have been reflected in rising patient satisfaction scores and 
growing sales in retail operations. 

Management must also reward performance. At Empire, Balzarini set up a program called 
“You Rock.” Any employee who observes an excellent action by another employee, beyond 
mere job requirements, acknowledges the good work with a card awarding points redeemable 
in the hospitals’ retail areas. Balzarini also sends weekly thank-you cards to workers who showed 
outstanding performance. 

Exhibit 9.3 shows that total quality management programs measure performance against 
customers’ standards—not against standards determined by quality engineers within the company. 
All changes within the organization are oriented toward improvement of customers’ percep- 
tions of quality. The exhibit indicates the need for integration of establishing consumer require- 
ments, quantifying benchmark measures, setting objectives, conducting research studies, and 
making adjustments in the organization to improve quality. Continuous quality improvement is 
an ongoing process. 

The activities outlined in Exhibit 9.3 work for providers of both goods and services. However, 
service products and customer services offered along with goods have some distinctive aspects. We 
will first discuss the quality of goods and then consider the quality of services. 
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In general, consumer and industrial goods providers track customer satisfaction to investigate 
customer perceptions of product quality by measuring perceptions of the product characteristics 
listed in Exhibit 9.4. These studies measure whether a firm’s perceptions about product char- 
acteristics conform to customers’ expectations and how these perceptions change over time. For 
example, any customer satisfaction survey will investigate a good’s performance by asking, “How 
well does the product perform its core function?” To determine the quality of a recycling lawn 
mower, a researcher might ask, “How well does the mower cut grass and eliminate the need for 
bagging clippings?” The researcher may ask questions to determine whether the product’s quality 
of performance was a delightful surprise, something well beyond expected performance. Similar 
questions will cover the other major product characteristics. 


I Quality Dimensions for Goods and Services 


Quality Dimension Characteristic Example 

Goods 

Performance The product performs its core function. A razor gives a close shave. 

Features The product has auxiliary dimensions that A motor oil comes in a convenient package. 


Conformance with specifications 


Reliability 


Durability 


Serviceability 


Aesthetic design 


Services 
Access 


Communication 


provide secondary benefits. 
There is a low incidence of defects. 
The product performs consistently. 


The economic life of the product is within an 
acceptable range. 


The system for servicing the product is efficient, 
competent, and convenient. 


The product's design makes it look and feel like a 
quality product. 


Contact with service personnel is easy. 


The customer is informed and understands the 
service and how much it will cost. 


Napa Valley wine comes from Napa Valley. 

A lawn mower works properly each time it is used. 
A motorcycle runs fine for many years. 

A computer software manufacturer maintains 

a toll-free phone number staffed by technical 
people who can answer questions quickly and 


accurately. 


A snowmobile is aerodynamic. 


A visit to the dentist does not involve a long wait. 


A computer technician explains needed repairs 
without using overly technical terms. 


Competence The service providers have the required skills. A tax accountant has a CPA certification. 
Courtesy Personnel are polite and friendly. Bank tellers smile and wish the customer a “good 
day” at the close of each transaction. 
Reliability The service is performed consistently and Employees of the office cleaning service arrive 
personnel are dependable. on schedule every Friday evening after working 
hours. 
Credibility Service providers have integrity. The doctor who is performing a heart transplant is 


Source: Adapted from Aaker, David A., Managing Brand Equity (New York: Macmillan, 1991), 90-95. 


trustworthy and believable. 


Measuring service disconfirmation involves comparing expectations with performance. 
Favorable quality and performance better than expected leads to satisfaction. Time after 
time, studies have shown differences between what customers expected and what the front- 
line service personnel delivered. Researchers direct a lot of effort toward assessing consumer 
expectations. 

In organizations that wish to improve service quality, managers must identify and analyze 
customer service needs and then establish specifications for the level of service. They must then 


e Surveys are the most widely used qualitative research, before undertaking primary research 


method of collecting primary quantita- activities. 
2 tive data for business research. However, e Error exists in all survey research. 
E a very common error in business research is e Random sampling error is present due to chance varia- 
z to begin questionnaire design and the survey tion in the sample elements and can only be addressed 
z process too soon. through large sample size. 
à e Be sure to fully exhaust secondary research sources before e Systematic error is due to a flaw in the research design or 
3 undertaking primary research activities. execution. It is our job as a business researcher to mini- 
Š e Be sure to have a clear understand of the research mize systematic error. 
o 
@ 


issues and objectives, often gained through exploratory 


train frontline personnel and give them the responsibility for quality service. Frontline personnel 
need to be motivated and encouraged to deliver the service that goes beyond consumer expecta- 
tions. Finally, regular surveys with both external customers and internal employees measure results 
against standards. 

Researchers investigate service quality to measure customer satisfaction and perceived quality 
in terms of the service attributes listed in Exhibit 9.4. Considerations in the actual measurement of 
quality of goods and service delivery are further addressed in Chapters 13, 14, and 15. 


Summary 


1. Define surveys and explain their advantages. The survey is a common tool for asking respon- 
dents questions. Surveys can provide quick, inexpensive, and accurate information for a variety 
of objectives. The term sample survey is often used because a survey is expected to obtain a 
representative sample of the target population. 


2. Describe the type of information that may be gathered in a survey. The typical survey is a 
descriptive research study with the objective of measuring awareness, knowledge, behavior, 
opinions and attitudes, both inside and outside of the organization. Common survey populations 
including customers, employees, suppliers and distributors. 


3. Identify sources of error in survey research. Two major forms of error are common in survey 
research. The first, random sampling error, is caused by chance variation and results in a sample that 
is not absolutely representative of the target population. Such errors are inevitable, but they can be 
predicted using the statistical methods discussed in later chapters on sampling. The second major 
category of error, systematic error, takes several forms. Nonresponse error is caused by subjects’ 
failing to respond to a survey. This type of error can be identified by comparing the demograph- 
ics of the sample population with those of the target population and reduced by making a special 
effort to contact underrepresented groups. In addition, response bias occurs when a response to 
a questionnaire is falsified or misrepresented, either intentionally or inadvertently. There are four 
specific categories of response bias: acquiescence bias, extremity bias, interviewer bias, and social 
desirability bias. An additional source of survey error comes from administrative problems such as 
inconsistencies in interviewers’ abilities, cheating, coding mistakes, and so forth. 


4. Distinguish among the various categories of surveys. Surveys may be classified according to 
methods of communication, by the degrees of structure and disguise in the questionnaires, and on 
a temporal basis. Questionnaires may be structured, with limited choices of responses, or unstruc- 
tured, to allow open-ended responses. Disguised questions camouflage the real purpose and may 
be used to probe sensitive topics. Surveys may consider the population at a given moment or fol- 
low trends over a period of time. The first approach, the cross-sectional study, usually is intended 
to separate the population into meaningful subgroups. The second type of study, the longitudinal 
study, can reveal important population changes over time. Longitudinal studies may involve con- 
tacting different sets of respondents or the same ones repeatedly. One form of longitudinal study 
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is the consumer panel. Consumer panels are expensive to conduct, so firms often hire contractors 
who provide services to many companies, thus spreading costs over many clients. 


5. Discuss the importance of survey research to total quality management programs. Total 
quality management is the process of implementing and adjusting a firm’s business strategy to 
assure customers’ satisfaction with the quality of goods or services. The level of quality is the 
degree to which a good or service is seen as good or bad by customers. Business research pro- 
vides companies with feedback about the quality of goods and services. Implementing a total 
quality management program requires considerable survey research, conducted routinely, to ask 
customers to rate a company against its competitors. It also measures employee attitudes and 
monitors company performance against benchmark standards. After identifying customer prob- 
lems and desires, the firm tracks satisfaction and quality ratings in successive waves. Total quality 
management research is an ongoing process for continuous quality improvement that works for 
both marketers of goods and service providers. 


Key Terms and Concepts 


acquiescence bias, 192 longitudinal study, 197 sample selection error, 194 


administrative error, 194 no contacts, 190 sample survey, 186 
self-selection bias, 191 
social desirability bias, 193 


structured question, 195 


consumer panel, 198 nonrespondents, 190 


cross-sectional study, 196 nonresponse error, 190 
data-processing error, 194 random sampling error, 188 
refusals, 190 


respondent error, 189 


disguised questions, 196 
extremity bias, 193 


systematic error, 189 
total quality management, 198 


interviewer bias, 193 
interviewer cheating, 194 
interviewer error, 194 


respondents, 186 
response bias, 191 
sample bias, 189 


tracking study, 198 
undisguised questions, 196 
unstructured question, 196 


Questions for Review and Critical Thinking 


1. Name several nonbusiness applications of survey research. c. Researchers who must conduct a 45-minute personal inter- 

2. What is self-selection bias? How might we avoid this? view decide to offer $25 to each respondent because they 

3. Do surveys tend to gather qualitative or quantitative data? What believe that people who will sell their opinions are more typi- 
types of information are commonly measured with surveys? cal than someone who will talk to a stranger for 45 minutes. 

4. Give an example of each type of error listed in Exhibit 9.1. d. A company’s sales representatives are asked what percentage 

5. Ina survey, chief executive officers (CEOs) indicated that of the time they spend making presentations to prospects, 
they would prefer to relocate their businesses to Atlanta (first traveling, talking on the telephone, participating in meet- 
choice), San Diego, Tampa, Los Angeles, or Boston. The ings, working on the computer, and engaging in other 
CEOs who said they planned on building new office space on-the-job activities. 
in the following year were asked where they were going to e. A survey comes with a water hardness packet to test the 
build. They indicated they were going to build in New York, hardness of the water in a respondent’s home. The packet 
Los Angeles, San Francisco, or Chicago. Explain the difference includes a color chart and a plastic strip to dip into hot 
between these two responses. water. The respondent is given instructions in six steps on 

6. What potential sources of error might be associated with the how to compare the color of the plastic strip with the color 


following situations? 

a. Ina survey of frequent fliers age 50 and older, research- 
ers concluded that price does not play a significant role in 
airline travel because only 25 percent of the respondents 
check off price as the most important consideration in 
determining where and how they travel. 

b. A survey of voters finds that most respondents do not like 
negative political ads—that is, advertising by one political 
candidate that criticizes or exposes secrets about the oppo- 
nent’s “dirty laundry.” 


chart that indicates water hardness. 
A researcher investigating public health issues goes into a junior 
high school classroom and asks the students if they have ever 
smoked a cigarette. The students are asked to respond orally in 
the presence of other students. What types of error might enter 
into this process? What might be a better approach? 
A survey conducted by the National Endowment for the Arts 
asked, “Have you read a book within the last year?” What 
response bias might arise from this question? 
Name some common objectives of cross-sectional surveys. 


Chapter 9: Survey Research: An Overview 


10. Give an example of a political situation in which longitudinal 
research might be useful. Name some common objectives for 
a longitudinal study in a business situation. 

11. What are the advantages and disadvantages of using consumer 
panels? 

12. Search either your local newspaper, the Wall Street Journal, 
or USA Today to find some news story derived from survey 
research results. Often, these stories deal with public opinions 
about product complaints, product consumption, job-related 
issues, marriage and family, public policy issues, or politics. Was 
the study’s methodology appropriate to draw conclusions? 


Research Activities 


1. ‘NET Go to Survey Monkey (http://www.surveymonkey.com). 
Then, visit http://www.mysurvey.com. What is the difference 
between the two Web sites in terms of the services they pro- 
vide to users? 

2. ‘NET The National Longitudinal Surveys (NLS) conducted by 
the Bureau of Labor Statistics provide data on the labor force 
experience (current labor force and employment status, work 
history, and characteristics of current or last job) of five groups 
of the U.S. population. Go to http://www.bls.gov/opub/hom/ 
homtoc.htm to learn about the objectives and methodology 
for this study. How accurate do you believe the information 
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13. Suppose you are the research director for your state’s tourism 
bureau. Assess the state’s information needs, and identify the 
information you will collect in a survey of tourists who visit 
your state. 

14. ETHICS A researcher sends out 2,000 questionnaires via e-mail. 
Fifty are returned because the addresses are inaccurate. Of 
the 1,950 delivered questionnaires, 100 are completed and 
e-mailed back. However, 40 of these respondents wrote that 
they did not want to participate in the survey. The researcher 
indicates the response rate was 5.0 percent. Is this the right 
thing to do? 


reported here really is? What sources of error might be present 
in the data? 

3. Ask a small sample of students at your university to report their 
GPA. Then, try to find the average GPA of students at your 
school. If you have to, ask several professors to give their opinion. 
Does it seem that the student data are subject to error? Explain. 

4. ‘NET Located at the University of Connecticut, the Roper 
Center is the largest library of public opinion data in the world. 
An online polling magazine and the methodology and findings 
of many surveys may be found at http://www.ropercenter.uconn.edu. 
Report on an article or study of your choice. 


Case 9.1 SAT and ACT Writing Tests 
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The SAT and ACT college entrance exams once 
were completely multiple choice, but both tests 
recently began including an essay portion (which 
is optional for the ACT). Some researchers have 
investigated how the essay tests are used by one 


group they serve: the admissions offices of the 
colleges that look at test results during the selection process." 

Early survey research suggests that some admissions officers 
harbor doubts about the essay tests. ACT, Inc. reported that among 
the schools it surveyed, only about one-fifth are requiring that 
applicants take the writing portion of the exam. Another one-fifth 
merely recommend (but don’t require) the essay. 

Kaplan, Inc., which markets test preparation services, con- 
ducted surveys as well. Kaplan asked 374 colleges whether they 
would be using the SAT writing test in screening candidates. 
Almost half (47 percent) said they would not use the essay at all. 


Another 22 percent said they would use it but give it less weight 
than the math and verbal SAT scores. 

Kaplan also surveys students who take the exams for which it 
provides training. On its Web site, the company says, “More than 
25 percent of students ran out of time on the essay!” 


Questions 

1. What survey objectives would ACT have in asking colleges 
how they use its essay test? What objectives would Kaplan have 
for its survey research? 

2. Ifyou were a marketer for the College Board (the SAT’s com- 
pany) or ACT, Inc., what further information would you want 
to gather after receiving the results described here? 

3. What sources of error or response bias might be present in the 
surveys described here? 


Case 9.2 The Walker Information Group 
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The Walker Information Group is among the 
largest research companies in the world. Walker’s 
clients include many Fortune 500 and blue 

chip industry leaders such as Cummins Engine 
Company, Lenscrafters, Continental Cablevision, 
| Florida Power and Light, and Oglethorpe Power 
Corporation. 


The Indianapolis-based company was founded in 1939 as a 
field interviewing service by Tommie Walker, mother of Frank 
Walker, the current chairman and chief executive officer of the 
organization. In the 1920s Tommie Walker’s late husband worked 
for a bank that was considering sponsoring an Indianapolis radio 
show featuring classical music. The bank wanted to know who was 
listening to this show. Tommie was hired to do the interviewing, 
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and she threw herself into the work. After that, referrals brought 
her more interviewing work for surveys. During an interview with 
a woman whose husband was a district sales manager for the A&P 
grocery chain, she learned that A&P was looking for a surveyor in 
the Midwest. A&P’s sales manager liked Tommie, but wouldn’t 
hire anyone without a formal company, a field staff, and insurance. 
Tommie founded Walker Marketing Research on October 20, 
1939, and her business with A&P lasted 17 years. 

Today, the Walker Information Group specializes in business, 
health care, and consumer research, as well as database marketing. 
The company is organized into six strategic business units. 

Walker Research conducts traditional market research ser- 
vices that range from questionnaire design and data collection to 
advanced analysis and consultation. Walker has expertise in helping 
companies measure how their actions are perceived by the audi- 
ences most important to them, and how these perceptions affect 
their image, reputation, corporate citizenship, recruiting, sales, and 
more. 

Data Source is a business unit that primarily is concerned with 
data collection and processing data. It specializes in telephone data 
collection. 

Customer Satisfaction Measurement (CSM), as the name 
implies, specializes in measuring customer satisfaction and in helping 
clients improve their relationship with customers. 

CSM Worldwide Network spans more than 50 countries. 

It is the first international network of professional research and 
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consulting businesses dedicated to customer satisfaction measure- 
ment and management. The CSM Worldwide Network assures 
that multicountry customer satisfaction research is consistent by 
taking into account local conditions and cultural norms. Network 
members are trained to use consistent methods that allow stan- 
dardization and comparability of information from country to 
country. 

Walker Direct designs and develops databases and implements 
direct-marketing programs that help generate leads for businesses 
and raise funds for nonprofit organizations. 

Walker Clinical is a health-care product use research company. 
Walker helps pharmaceutical, medical-device, and consumer- 
product manufacturers test how well new products work and how 
customers like them. 


Questions 

1. What type of custom survey research projects might Walker 
Market Research and Analysis conduct for its clients? 

2. What stages are involved in conducting a survey? For which 
stages might a client company hire a research supplier like 
Walker Research? Data Source? 

3. What is the purpose of customer satisfaction measurement? 


a 


What measures, other than findings from surveys, might a com- 
pany use to evaluate the effectiveness of a total quality manage- 
ment program? 


CHAPTER 10 
SURVEY RESEARCH: 
COMMUNICATING 
WITH RESPONDENTS 


After studying this chapter, you should be able to 

1. Summarize ways researchers gather information through 
interviews 

2. Compare the advantages and disadvantages of conducting 
door-to-door, mall intercept, and telephone interviews 


3. Evaluate the advantages and disadvantages of distribut- 
ing questionnaires through the mail, the Internet, and by 
other means 

4. Discuss the importance of pretesting questionnaires 

5. Describe ethical issues that arise in survey research 


Chapter Vignette: Mobile Surveys Catching On, 
and Catching Respondents “On the Go”! 


The use of cell phones as a basic communication and information 
management device has led to several new ways to 

capture the opinions of others. This has largely been a 
function of SMS (or short message service) text messag- 

ing. Young and old alike have developed an amazing 

new skill, often referred to as “texting,” as a means to 
communicate with others via short messages through 

their cell phones. The implications for this new skill 

shared by so many have not been lost on the business 
research market. 

Mobile surveying technologies now integrate SMS text 
messaging with electronic surveys. If a phone has SMS 
technology, recipients of a mobile survey receive an SMS 
text message, where they can answer single or multiple 
choice questions, or even provide open-ended responses to 
questions, anytime or anywhere. The use of these types of 
“instant feedback” survey responses can have many different 
business applications. 

For example, business researchers may wish to capture con- 
sumer reactions to products over time, or may wish to get an 
instant “first impression,” as they use a product initially. Perhaps d 
a firm wishes to capture instant feedback from a training exercise, ~ 

or may wish to capture or understand respondent attitudes to a 
particular part of a meeting or event. In fact, current researchers 
interested in experiential surveying use mobile surveys to capture 
people’s feelings at that particular instant, and thus can create a 


longitudinal understanding of people’s attitudes and emotional 
states over time. 


CK 
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Mobile surveying is an exciting new way to capture data on respondents, no matter where they 


are. Texting is here to stay—perhaps the next time you see someone furiously texting on their cell 
phone, they are responding to a mobile survey “on the go”! 
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Electronic dating services 

have become a popular, 
successful example of electronic 
interactive media. 
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Introduction 


During most of the twentieth century, obtaining survey data involved inviting individuals to 
answer questions asked by human interviewers (interviews) or questions they read themselves 
(questionnaires). Interviewers communicated with respondents face-to-face or over the telephone, 
or respondents filled out self-administered paper questionnaires, which were typically distributed 
by mail. These media for conducting surveys remain popular with business researchers. However, 
as the preceding vignette suggests, digital technology is having a profound impact on society in 
general and on business research in particular. Its greatest impact is in the creation of new forms 
of communications media. 


Interviews as Interactive Communication 


When two people engage in a conversation, human interaction takes place. Human interac- 
tive media are a personal form of communication. One human being directs a message to and 
interacts with another individual (or a small group). When most people think of interview- 
ing, they envision two people engaged in a face-to-face dialogue or a conversation on the 
telephone. 

Electronic interactive media allow researchers to reach a large audience, personalize individual 
messages, and interact using digital technology. To a large extent, electronic interactive media are 


controlled by the users themselves. No other human need 
be present. Survey respondents today are not passive audi- 
ence members. They are actively involved in a two-way 
communication using electronic interactive media. 

The Internet is radically altering many organizations’ 
research strategies, providing a prominent example of the 
new electronic interactive media. Consumers determine 
what information they will be exposed to by choosing 
what sites to visit and by blocking or closing annoying 
pop-up ads. Electronic interactive media also include CD- 
ROM and DVD materials, touch-tone telephone systems, 
touch-screen interactive kiosks in stores, and other forms 
of digital technology. 


Noninteractive Media 


The traditional questionnaire received by mail and com- 
pleted by the respondent does not allow a dialogue or an 
exchange of information providing immediate feedback. 
So, from our perspective, self-administered questionnaires 
printed on paper are noninteractive. This fact does not 
mean that they are without merit, just that this type of 
survey is less flexible than surveys using interactive com- 
munication media. 

Each technique for conducting surveys has merits and 
shortcomings. The purpose of this chapter is to explain 
when researchers should use different types of surveys. 
The chapter begins with a discussion of surveys that use 
live interviews. Then we turn to noninteractive, self- 
administered questionnaires. Finally, we explain how the 
Internet and digital technology are dramatically changing 
survey research. 
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a) j Surveys can be classified 
$ a number of different 
í V ways. For instance, they 
Y can be interactive or nonin- 
í teractive. They can also be 
classified based on the media 
used to collect the information. 
How would you describe the “Survey This!” sur- 
vey approach? Is it interactive? Also, consider 
the likely response rate if this were used to 
randomly study college students like yourself 
via e-mail solicitation. Try sending the link to 
the survey to 10 friends and check to see how 
many actually respond to it (friends not taking 
this class with you). What factors of this survey 
contribute to either a relatively high or rela- 
tively low response rate? 


||| @ Internet ® 100% + 4 


Personal Interviews 


To conduct interviews, the researcher may communicate with individuals in person by going door- 
to-door or intercepting them in shopping malls, or interviews may take place over the telephone. 
Traditionally, researchers have recorded interview results using paper and pencil, but computers are 
increasingly supporting survey research. In this section, we examine the general characteristics of face- 
to-face personal interviews, then compare the characteristics of door-to-door personal interviews and 
personal interviews conducted in shopping malls. The next section examines telephone interviews. 
Gathering information through face-to-face contact with individuals goes back many years. 
Periodic censuses were used to set tax rates and aid military conscription in the ancient empires 
of Egypt and Rome.' During the Middle Ages, the merchant families of Fugger and Rothschild 
prospered in part because their far-flung organizations enabled them to get information before 
their competitors could.? Today, survey researchers typically present themselves in shopping cen- 
ters and street corners throughout the United States and announce, “Good afternoon, my name is 
. Lam with Company, and we are conducting a survey 


” 


on 


A personal interview is a form of direct communication in which an interviewer asks respon- 
dents questions face-to-face. This versatile and flexible method is a two-way conversation between 
interviewer and respondent. 


Advantages of Personal Interviews 


Business researchers find that personal interviews offer many unique advantages. One of the most 
important is the opportunity for detailed feedback. 


OPPORTUNITY FOR FEEDBACK 


Personal interviews, similar to those mentioned in the Research Snapshot on the next page, pro- 
vide the opportunity for feedback and clarification. For example, if a consumer is reluctant to 
provide sensitive information, the interviewer may offer reassurance that his or her answers will be 
strictly confidential. Personal interviews offer the lowest chance that respondents will misinterpret 


personal interview 


Face-to-face communication 
in which an interviewer asks a 
respondent to answer questions. 
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COURTESY OF QUALTRICS.COM 
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The Challenge of Assessing Adult Literacy 
The need to understand and address functional adult literacy 

is animportant one. The term functionally literate is often 
misunderstood—in reality, it is the degree to which adults can 
adequately “function” with written materials they are exposed to 
in their daily lives. Illiteracy creates clear and in some instances 
not-so-clear challenges for adults. While it is clear that a person’s 
literacy is certainly tied to their ability to obtain a good job, they 
are also challenged by the everyday use of printed and written 
information such as newspapers, bank statements, and even 
medication prescription instructions. The question is how to 
understand the level of illiteracy in a population when those 
individuals you are most interested in (i.e., the adult illiterate) may 


not or cannot respond to a written questionnaire in the first place. 


In the United States, the 2003 National Assessment of Adult 
Literacy (NAAL) recognized this challenge early and developed 
one of the most comprehensive personal interview and assess- 
ment programs ever attempted. Using a stratified sample of 
over eighteen thousand 
adults, they conducted in- 
home personal interviews 
that took approximately 
90 minutes to complete. 


During these interviews, a multistage assess- 
ment was conducted. Respondents were 
given a short and very simple screening 
questionnaire, which would determine if 
they could proceed. If the respondent could 
not complete the short screening tool, they 
were not required to go further with the literacy assessment, and 
were scored on a normed scale as functionally illiterate. For those 
that could complete the screening questions, example materi- 
als—such items as store coupons, telephone bills, and driving 
directions—were carefully presented, with the respondents 
answering a questionnaire related to those everyday items. 

The direct and interactive nature of the assessment was 
critically important to the NAAL’s success. As a result, the U.S. 
Department of Education was able to comprehensively under- 
stand the degree of adult illiteracy within the United States, and 
ultimately capture demographic and socioeconomic character- 
istics of those adults who were challenged from a literacy stand- 
point. It was the hard work of highly trained personal interview- 
ers that helped the Department of Education address this critical 
national question. 


Source: National Assessment of Adult Literacy, http://nces.ed.gov/NAAL/. 


questions, because an interviewer who senses confusion can clarify the instruction or questions. 


Circumstances may dictate that at the conclusion of the interview, the respondent be given addi- 


tional information concerning the purpose of the study. This clarification is easily accomplished 


with a personal interview. If the feedback indicates that some question or set of questions is particu- 


larly confusing, the researcher can make changes that make the questionnaire easier to understand. 


PROBING COMPLEX ANSWERS 


Another important characteristic of personal interviews is the opportunity to follow up by prob- 


ing. If a respondent’s answer is too brief or unclear, the researcher may request a more compre- 


hensive or clearer explanation. In probing, the interviewer asks for clarification with standardized 


questions such as “Can you tell me more about what you had in mind?” (See Chapter 7 on 


qualitative research for an expanded discussion of probing.) Although interviewers are expected 


to ask questions exactly as they appear on the questionnaire, probing allows them some flexibility. 


Depending on the research purpose, personal interviews vary in the degree to which questions 


are structured and in the amount of probing required. The personal interview is especially useful 


for obtaining unstructured information. Skilled interviewers can handle complex questions that 


cannot easily be asked in telephone or mail surveys. 


LENGTH OF INTERVIEW 


If the research objective requires an extremely lengthy questionnaire, personal interviews may be the 


only option. A general rule of thumb on mail surveys is that they should not exceed six pages, and 


telephone interviews typically last less than ten minutes. In contrast, a personal interview can be much 


longer, perhaps an hour and a half, as was the case for the U.S. National Adult Literacy Assessment. 


However, the longer the interview, no matter what the form, the more the respondent should be 


compensated for their time and participation. Researchers should also be clear about how long par- 


ticipation should take in the opening dialog requesting participation. Online surveys should include a 


completion meter that shows the progress a respondent has made toward completing the task. 
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COMPLETENESS OF QUESTIONNAIRE 


The social interaction between a well-trained interviewer and a respondent in a personal inter- 
view increases the likelihood that the respondent will answer all the items on the questionnaire. 
The respondent who grows bored with a telephone interview may terminate the interview at 
his or her discretion simply by hanging up the phone. Self-administration of a mail question- 
naire requires even more effort by the respondent. Rather than write lengthy responses, the 
respondent may fail to complete some of the questions. Item nonresponse—failure to provide 
an answer to a question—is least likely to occur when an experienced interviewer asks ques- 
tions directly. 


PROPS AND VISUAL AIDS 


Interviewing respondents face-to-face allows the investigator to show them new product samples, 
sketches of proposed advertising, or other visual aids. When Lego Group wanted to introduce 
new train model sets for its famous building bricks, the company targeted adults who build com- 
plex models with its product. The company invited adults who were swapping ideas at the Lego 
Web site to visit the New York office, where they viewed ideas and provided their opinions. The 
respondents wound up rejecting all the company’s ideas, but they suggested something different: 
the Santa Fe Super Chief set, which sold out within two weeks, after being advertised only by 
enthusiastic word of mouth.’ This research could not have been done in a telephone interview 
or mail survey. 

Research that uses visual aids has become increasingly popular with researchers who investi- 
gate film concepts, advertising problems, and moviegoers’ awareness of performers. Research for 
movies often begins by showing respondents videotapes of the prospective cast. After the movie 
has been produced, film clips are shown and interviews conducted to evaluate the movie’s appeal, 
especially which scenes to emphasize in advertisements. 


HIGH PARTICIPATION 


Although some people are reluctant to participate in a survey, the presence of an interviewer 
generally increases the percentage of people willing to complete the interview. Respondents 
typically are required to do no reading or writing—all they have to do is talk. Many people enjoy 
sharing information and insights with friendly and sympathetic interviewers. People are often 
more hesitant to tell a person “no” face-to-face than they are over the phone or through some 
impersonal contact. 


Disadvantages of Personal Interviews 


Personal interviews also have some disadvantages. Respondents are not anonymous and as a result 
may be reluctant to provide confidential information to another person. Suppose a survey asked 
top executives, “Do you see any major internal instabilities or threats (people, money, material, 
and so on) to the achievement of your marketing objectives?” Many managers may be reluctant 
to answer this sensitive question honestly in a personal interview in which their identities are 
known. 


INTERVIEWER INFLUENCE 


Some evidence suggests that demographic characteristics of the interviewer influence respon- 
dents’ answers. For example, one research study revealed that male interviewers produced larger 
amounts of interviewer variance than female interviewers in a survey in which 85 percent of the 
respondents were female. Older interviewers who interviewed older respondents produced more 
variance than other age combinations, whereas younger interviewers who interviewed younger 
respondents produced the least variance. 

Differential interviewer techniques may be a source of bias. The rephrasing of a question, 
the interviewer’s tone of voice, and the interviewer’s appearance may influence the respondent’s 


211 


item nonresponse 


Failure of a respondent to 
provide an answer to a survey 
question. 
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door-to-door interviews 


Personal interviews conducted 
at respondents’ doorsteps in an 
effort to increase the participa- 

tion rate in the survey. 


Part 3: Research Methods for Collecting Primary Data 


answer. Consider the interviewer who has conducted 100 personal interviews. During the 
next one, he or she may lose concentration and either selectively perceive or anticipate the 
respondent’s answer. The interpretation of the response may differ somewhat from what 
the respondent intended. Typically, the public thinks of the person who does marketing research 
as a dedicated scientist. Unfortunately, some interviewers do not fit that ideal. Considerable 
interviewer variability exists. Cheating is possible; interviewers may cut corners to save time and 
energy, faking parts of their reports by dummying up part, or all, of the questionnaire. Control 
over interviewers is important to ensure that difficult, embarrassing, or time-consuming ques- 
tions are handled properly. 


LACK OF ANONYMITY OF RESPONDENT 


Because a respondent in a personal interview is not anonymous and may be reluctant to provide 
confidential information to another person, researchers often spend considerable time and effort to 
phrase sensitive questions to avoid social desirability bias. For example, the interviewer may show 
the respondent a card that lists possible answers and ask the respondent to read a category number 
rather than be required to verbalize sensitive answers. 


COST 


Personal interviews are expensive, generally substantially more costly than mail, Internet, or tele- 
phone surveys. The geographic proximity of respondents, the length and complexity of the ques- 
tionnaire, and the number of people who are nonrespondents because they could not be contacted 
(not-at-homes) will all influence the cost of the personal interview. 


Door-to-Door Interviews and Shopping Mall Intercepts 


Personal interviews may be conducted at the respondents’ homes or offices or in many other 
places. Increasingly, personal interviews are being conducted in shopping malls. Mall intercept 
interviews allow many interviews to be conducted quickly. Often, respondents are intercepted 
in public areas of shopping malls and then asked to come to a permanent research facility to 
taste new food items or to view advertisements. The locale for the interview generally influ- 
ences the participation rate, and thus the degree to which the sample represents the general 
population. 


DOOR-TO-DOOR INTERVIEWS 


The presence of an interviewer at the door generally increases the likelihood that a person will 
be willing to complete an interview. Because door-to-door interviews increase the participation 
rate, they provide a more representative sample of the population than mail questionnaires. For 
example, response rates to mail surveys are substantially lower among Hispanics whether the ques- 
tionnaire is printed in English or Spanish.* People who do not have telephones, who have unlisted 
telephone numbers, or who are otherwise difficult to contact may be reached using door-to-door 
interviews. However, door-to-door interviews may underrepresent some groups and overrepre- 
sent others based on the geographic areas covered. 

Door-to-door interviews may exclude individuals who live in multiple-dwelling units with 
security systems, such as high-rise apartment dwellers, or executives who are too busy to grant 
personal interviews during business hours. Other people, for security reasons, simply will not 
open the door when a stranger knocks. As seen in the Research Snapshot on the next page, 
elderly adults, or people in retirement dwellings, may also be excluded. Telephoning an indi- 
vidual in one of these subgroups to make an appointment may make the total sample more 
representative. However, obtaining a representative sample of this security-conscious subgroup 
based on a listing in the telephone directory may be difficult. For these reasons, door-to-door 
interviews are becoming a thing of the past. 
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( Being Good Neighbors Means 
~ Learning about Them First 
The use of door-to-door surveys has 

always represented a challenge for business 
researchers. They require well-trained survey 
administrators and can cost a significant amount of money. In 
addition to the costs, ensuring that you have the correct popula- 
tion of interest complicates the process further. 

These challenges are not lost on communities as well. 
Communities often have limited resources and few ways to cap- 
ture the needs of its citizens. The need to conduct door-to-door 
surveys is often the only way to meet and capture the attitudes 
and beliefs of specific populations in a particular city or town. 

In 2004-2005 St. Louis Community College at Meramec rec- 
ognized an opportunity to engage their students in a service 
learning project and capture information from an often missed 
demographic in our society—the elderly. They established a 
door-to-door survey of older adults to support an initiative 
entitled Older Adults—Honoring and Caring for Our Elders. Elderly 
residents, in particular those that live in nursing homes and 
assisted living facilities, may have no phones and are likely to 
have some challenges in filling out questionnaires without some 


assistance. Two students, with the support of community orga- 
nizers, mapped the neighborhoods and divided the city into 
zones to ensure that the area was covered successfully. Students 
conducted door-to-door surveys in the area, capturing 680 
surveys from older adults. 

Their hard work led to the inclusion of elderly adult needs 
as part of the Good Neighbor Initiative, which included pro- 
grams for literacy, hunger, homelessness, and health. Without 
going from house to house, it may not have been possible for 
the community to capture the specific needs of this important 
population in their city. In the end, students had an enlightened 
learning experience, and 
gained an understanding 
of the elderly adults in their 
own neighborhoods. Good 
neighbors indeed! 


Source: Halsband, D., Welch, G., & 
Fuller, M., “Community Survey Leads 
to Learning from and Caring for 

Our Elders” (paper presented at the 
annual national conference for the 
Community College National Center for 
Community Engagement, May 2008). 


Reprinted by permission of the authors. 


CALLBACKS 


When a person selected to be in the sample cannot be contacted on the first visit, a systematic 
procedure is normally initiated to call back at another time. Callbacks, or attempts to recontact 
individuals selected for the sample, are the major means of reducing nonresponse error. Calling 
back a sampling unit is more expensive than interviewing the person the first time around, because 
subjects who initially were not at home generally are more widely dispersed geographically than 
the original sample units. Callbacks in door-to-door interviews are important because not-at- 
home individuals (for example, working parents) may systematically vary from those who are at 
home (nonworking parents, retired people, and the like). 


MALL INTERCEPT INTERVIEWS 


Personal interviews conducted in shopping malls are referred to as mall intercept interviews, or 
shopping center sampling. Interviewers typically intercept shoppers at a central point within the mall 
or at an entrance. The main reason mall intercept interviews are conducted is because their costs 
are lower. No travel is required to the respondent’s home; instead, the respondent comes to the 
interviewer, and many interviews can be conducted quickly in this way. 

A major problem with mall intercept interviews is that individuals usually are in a hurry to 
shop, so the incidence of refusal is high—typically around 50 percent. Yet it is standard practice 
for many commercial research companies, who conduct more personal interviews in shopping 
malls than it conducts door-to-door. 

In a mall interview, the researcher must recognize that he or she should not be looking for a 
representative sample of the total population. Each mall has its own target market’s characteristics, 
and there is likely to be a larger bias than with careful household probability sampling. However, 
personal interviews in shopping malls are appropriate when the target group is a special market 
segment such as the parents of children of bike-riding age. If the respondent indicates that he or 
she has a child of this age, the parent can then be brought into a rented space and shown several 
bikes. The mall intercept interview allows the researcher to show large, heavy, or immobile visual 
materials, such as a television commercial. A mall interviewer can give an individual a product to 


callbacks 


Attempts to recontact individuals 
selected for a sample who were 
not available initially. 


mall intercept interviews 


Personal interviews conducted in 
a shopping mall. 
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—George Santayana 


telephone interviews 


Personal interviews conducted 
by telephone, the mainstay of 
commercial survey research. 
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take home to use and obtain a commitment that the respondent will cooperate when recontacted 
later by telephone. Mall intercept interviews are also valuable when activities such as cooking and 
tasting of food must be closely coordinated and timed to follow each other. They may also be 
appropriate when a consumer durable product must be demonstrated. For example, when video- 
cassette recorders and DVD players were innovations in the prototype stage, the effort and space 
required to set up and properly display these units ruled out in-home testing. 


Global Considerations 


Willingness to participate in a personal interview varies dramatically around the world. For exam- 
ple, in many Middle Eastern countries women would never consent to be interviewed by a man. 
And in many countries the idea of discussing grooming behavior and personal-care products with a 
stranger would be highly offensive. Few people would consent to be interviewed on such topics. 

The norms about appropriate business conduct also influence businesspeople’s willingness to 
provide information to interviewers. For example, conducting business-to-business interviews in 
Japan during business hours is difficult because managers, strongly loyal to their firm, believe that 
they have an absolute responsibility to oversee their employees while on the job. In some cultures 
when a businessperson is reluctant to be interviewed, a reputable third party may be asked to 
intervene so that an interview may take place. 


Telephone Interviews 


For several decades, landline telephone interviews have been the mainstay of commercial survey 
research. The quality of data obtained by telephone is potentially comparable to the quality of data 
collected face-to-face. Respondents are more willing to provide detailed and reliable information 
on a variety of personal topics over the phone while in the privacy of their own homes than when 
answering questions face-to-face. 

In-home phone surveys are still considered capable of providing fairly representative samples 
of the U.S. population. However, the “no-call” legislation dating back to the middle of the first 
decade of the twenty-first century has limited this capability somewhat. Business researchers can- 
not solicit information via phone numbers listed on the do-not-call registry. Thus, to the extent 
that consumers who place their numbers on these lists share something in common, such as a 
greater desire for privacy, a representative sample of the general population cannot be obtained. 
Marketers and marketing researchers can obtain the do-not-call lists of phone numbers from the 
FTC for $62 per area code. The entire registry can be obtained for $17,050. This information can 
be obtained from the FTC do-not-call Web site shown in the screenshot on page 215. Although 
this may seem expensive, the FTC levies fines on the order of $10,000 per violation (per call) so 
obtaining the registry is a wise investment for those wishing to contact consumers via telephone. 
AT&T faced fines of over three-quarters of a million dollars for making 78 unwanted calls to 29 
consumers listed on the do-not-call list. So, the Feds do take violations very seriously. 

Likewise, the Canadian government has instituted a nearly identical do-not-call program. The 
Canadian Radio-Television and Telecommunications Commission imposes fines up to $11,000 
per call for calls made to people on the Canadian do-not-call list. Other countries in Europe and 
elsewhere are also considering such legislation. The advantages of privacy simply make phones 
less capable of obtaining representative samples than they once were. Often, however, a landline 
phone call is still the researcher’s best option. 


MOBILE PHONE INTERVIEWS 


Mobile phone interviews differ from landline phones most obviously because they are directed 
toward a mobile (i.e., cell) phone number. However, there are other less obvious distinctions. 


e Inthe U.S., no telemarketing can be directed toward mobile phone numbers by law. The 
primary reason for enacting this law was that respondents would often have to pay to receive 
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the call. Respondents would have to “opt in” before 
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such calls. 


e The recipient of a mobile phone call is even more 


Cell Phones 


likely to be distracted than with a call to someone’s 


You may place your personal cell phone number on the National Do Not Call Registry. The registry hes accepted cell phone numbers since it 
2003. The 


home or office. In fact, the respondent may be driv- NATIONAL —— 

k 3 N . DO NOT CALL 

ing a car, on a subway train, or walking down a noisy rreIsTaY National Do Not Call Registry 

street. Factors such as this are not conducive to a high- praamienann poore e ke e e a a e e oe 
toj 

quality interview. TEE ath cpl Gi, A SER i SO LR 


sence number on the registry will stop most, but not all, telemarketing calls 
EWESPAROL 


e The area codes for mobile phones are not necessarily 
tied to geography. For instance, a person who moves 
from Georgia to Arizona can choose to keep his or 


her old phone number. Therefore, a researcher may 


be unable to determine whether or not a respondent 
fits into the desired geographic sampling population 
simply by taking note of the area code. 

e The phones have varying abilities for automated responses and differing keypads. Some 
requests, such as “hit pound sign,” may be more difficult to do on some keypads than on 
others. 


Phone Interview Characteristics 


Phone interviews in general have several distinctive characteristics that set them apart from other 
survey techniques. These characteristics present significant advantages and disadvantages for the 
researcher. 


SPEED 


One advantage of telephone interviewing is the speed of data collection. While data collection 
with mail or personal interviews can take several weeks, hundreds of telephone interviews can be 
conducted literally overnight. When the interviewer enters the respondents’ answers directly into 
a computerized system, the data processing speeds up even more. 


COST 


As the cost of personal interviews continues to increase, telephone interviews are becoming rela- 
tively inexpensive. The cost of telephone interviews is estimated to be less than 25 percent of the 
cost of door-to-door personal interviews. Travel time and costs are eliminated. However, the 
typical Internet survey is less expensive than a telephone survey. 


ABSENCE OF FACE-TO-FACE CONTACT 


Telephone interviews are more impersonal than face-to-face interviews. Respondents may 
answer embarrassing or confidential questions more willingly in a telephone interview than 
in a personal interview. However, mail and Internet surveys, although not perfect, are better 
media for gathering extremely sensitive information because they seem more anonymous. Some 
evidence suggests that people provide information on income and other financial matters only 
reluctantly, even in telephone interviews. Such questions may be personally threatening for a 
variety of reasons, and high refusal rates for this type of question occur with each form of survey 
research, 

Although telephone calls may be less threatening because the interviewer is not physi- 
cally present, the absence of face-to-face contact can also be a liability. The respondent can- 
not see that the interviewer is still writing down the previous comment and may continue to 
elaborate on an answer. If the respondent pauses to think about an answer, the interviewer 
may not realize it and may go on to the next question. Hence, there is a greater tendency for 


This site has information for you — whether you're a consumer interested in signing Up for the National Do Not Call Registry, or a telemarketer or seller 
interested in learning more about your responsibilities related to the Telemarketing Sales Rule. 
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interviewers to record no answers and incomplete answers in telephone interviews than in per- 
sonal interviews. 


COOPERATION 


One trend is very clear. In the last few decades, telephone response rates have fallen. Analysis of 
response rates for the long-running Survey of Consumer Attitudes conducted by the University of 
Michigan found that response rates fell from a high of 72 percent to 67 percent during the period 
from 1979 to 1996 and then even faster after 1996, dropping to 60 percent.* Lenny Murphy of data 
collection firm Dialtek says he has observed a decline in survey response rates from a typical range 
of 30 to 40 percent in the past down to below 20 percent.® Fewer calls are answered because more 
households are using caller ID and answering machines to screen their calls, and many individu- 
als do not pick up the phone when the display reads “out of area” or when an unfamiliar survey 
organization’s name and number appear on the display. Also, more phone lines are dedicated to fax 
machines and computers. However, the University of Michigan study found that the rate of refusal 
actually grew faster in the more recent period than the rate of not answering researchers’ calls. 

One way researchers can try to improve response rates is to leave a message on the household’s 
telephone answering machine or voice mail. However, many people will not return a call to help 
someone conduct a survey. Using a message explicitly stating that the purpose of the call is not 
sales related may improve responses. Other researchers simply hope to reach respondents when 
they call back, trying callbacks at different times and on different days. 

Further complicating the situation is the use of wireless mobile phone services.” Regulations 
by the Federal Communications Commission make it illegal for researchers to use automated 
dialing equipment to call mobile phones. Even if researchers dial the calls by hand, they may not 
contact anyone who would have to pay for the call—that is, most cell phone users. So far, only a 
small share of U.S. households (less than 4 percent) have given up their landlines, but those num- 
bers are growing, and they include a sizable segment of young adults. In fact, consumers may keep 
their phone numbers when they change to a new phone company, so many consumers who have 
abandoned landlines for cell phones may be keeping a phone number that telephone interviewers 
may no longer dial without penalty. 

Other countries may not adopt laws restricting calls to mobile phones. In addition, consumers 
in other countries are more open to responding to research delivered by voice or by text messag- 
ing. Thus, the mobile phone may be a better interview tool outside of the United States than in 
the United States. 

Refusal to cooperate with interviews is directly related to interview length. A major study of 
survey research found that interviews of 5 minutes or less had a refusal rate of 21 percent; inter- 
views of between 6 and 12 minutes had 41 percent refusal rates; and interviews of 13 minutes or 
more had 47 percent rates. In unusual cases, a few highly interested respondents will put up with 
longer interviews. A good rule of thumb is to keep telephone interviews approximately 10 to 15 
minutes long. In general, 30 minutes is the maximum amount of time most respondents will spend 
unless they are highly interested in the survey subject. 

Another way to encourage participation is to send households an invitation to participate in a 
survey. The invitation can describe the purpose and importance of the survey and the likely dura- 
tion of the survey. The invitation can also encourage subjects to be available and reassure them 
that the caller will not try to sell anything. In a recent study comparing response rates, the rates 
were highest among households that received an advance letter, somewhat lower when the notice 
came on a postcard, and lowest when no notice was sent.” 


INCENTIVES TO REPOND 


Respondents should receive some incentive to respond. Research addresses different types of 
incentives. For telephone interviews, test-marketing involving different types of survey intro- 
ductions suggests that not all introductions are equally effective. A financial incentive or some 
significant chance to win a desirable prize will produce a higher telephone response rate than a 
simple assurance that the research is not a sales pitch, a more detailed description of the survey, or 
an assurance of confidentiality.’ 
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REPRESENTATIVE SAMPLES 


Practical difficulties complicate obtaining representative samples based on listings in the telephone 
book. About 95 percent of households in the United States have landline telephones. People 
without phones are more likely to be poor, aged, rural, or living in the South. Unlisted phone 
numbers and numbers too new to be printed in the directory are a greater problem. People have 
unlisted phone numbers for two reasons: 


e They have recently moved 
e They prefer to have unlisted numbers for privacy 


Individuals whose phone numbers are unlisted because of a recent move differ slightly from those 
with published numbers. The unlisted group tends to be younger, more urban, and less likely to 
own a single-family dwelling. Households that maintain unlisted phone numbers by choice tend 
to have higher incomes. And, as previously mentioned, a number of low-income households are 
unlisted by circumstance. 

The problem of unlisted phone numbers can be partially resolved through the use of ran- 
dom digit dialing. Random digit dialing eliminates the counting of names in a list (for example, 
calling every fiftieth name in a column) and subjectively determining whether a directory listing 
is a business, institution, or legitimate household. In the simplest form of random digit dialing, 
telephone exchanges (prefixes) for the geographic areas in the sample are obtained. Using a 
table of random numbers, the last four digits of the telephone number are selected. Telephone 
directories can be ignored entirely or used in combination with the assignment of one or several 
random digits. Random digit dialing also helps overcome the problem due to new listings and 
recent changes in numbers. Unfortunately, the refusal rate in commercial random digit dial- 
ing studies is higher than the refusal rate for telephone surveys that use only listed telephone 
numbers. 


CALLBACKS 


An unanswered call, a busy signal, or a respondent who is not at home requires a callback. Tele- 
phone callbacks are much easier to make than callbacks in personal interviews. However, as men- 
tioned, the ownership of telephone answering machines is growing, and their effects on callbacks 
need to be studied. 


LIMITED DURATION 


Respondents who run out of patience with the interview can merely hang up. To encourage 
participation, interviews should be relatively short. The length of the telephone interview is defi- 
nitely limited. 


LACK OF VISUAL MEDIUM 


Because visual aids cannot be used in telephone interviews, this method is not appropriate for 
packaging research, copy testing of television and print advertising, and concept tests that require 
visual materials. Likewise, certain attitude scales and measuring instruments, such as the semantic 
differential (described in a later chapter), require the respondent to see a graphic scale, so they are 
difficult to use over the phone. 


Central Location Interviewing 


Research agencies or interviewing services typically conduct all telephone interviews from a cen- 
tral location. Such central location interviewing allows firms to hire a staff of professional interview- 
ers and to supervise and control the quality of interviewing more effectively. When telephone 
interviews are centralized and computerized, an agency or business can benefit from additional 
cost economies. 
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Use of telephone exchanges 
and a table of random numbers 
to contact respondents with 
unlisted phone numbers. 


central location 
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Telephone interviews conducted 
from a central location allowing 
firms to hire a staff of professional 
interviewers and to supervise and 
control the quality of interview- 
ing more effectively. 
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Automated Phone Surveys of Teens 


response to a live interviewer, because press- 


Automatic telephone surveys are a good way to reach all mem- ing keys on the keypad would feel more 
bers of the family, not just the head of the household. What if you confidential. 
wanted to ask questions about holiday shopping, what's for din- The interviewers were right. In the self- 
ner, or what kind of vacation the family would like? A short tele- administered survey, the teens were more 
phone survey may be the answer. One advantage is that no “real likely to say they had smoked in the past thirty 
person” has to hear the answers to potentially sensitive questions. days or, if they had not smoked, to lack a firm commitment not to 
Computer-assisted telephone interviewing (CATI) and com- smoke in the future. Many of them indicated a parent was pres- 
puterized self-interviewing, in which the subjects listened to ent while they answered the questions, and when they did, their 
prerecorded questions and then responded by entering answers responses were less likely to indicate smoking desire or susceptibil- 
with the telephone’s keypad, have been used to ask the “teen” ity. This pattern suggests that they might be underreporting their 
in the house about smoking. smoking behavior. These findings encourage researchers to be 
The researchers predicted attentive to confidentiality when working with teenage subjects. 
age ne young people Sources: “Survey: Consumers Say ‘Yes’ to Holiday Shopping,” Stores 83, no. 12 
would be more likely to (December 2001), 18; also based on Moskowitz, Joel M., “Assessment of Cigarette 
say they smoke in the self- Smoking and Smoking Susceptibility among Youth: Telephone Computer-Assisted 
nee Self-Interviews versus Computer-Assisted Telephone Interviews,” Public Opinion 
administered survey than in Quarterly 68 (Winter 2004), 565-587. 


computer-assisted 
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Technology that allows answers 
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for processing. 


Computer-Assisted Telephone Interviewing 


Advances in computer technology allow responses to telephone interviews to be entered directly 
into the computer in a process known as computer-assisted telephone interviewing (CATI). Tele- 
phone interviewers are seated at computer terminals. Monitors display the questionnaires, one 
question at a time, along with precoded possible responses to each question. The interviewer 
reads each question as it appears on the screen. When the respondent answers, the interviewer 
enters the response directly into the computer, and it is automatically stored in the computer’s 
memory. The computer then displays the next question on the screen. Computer-assisted tele- 
phone interviewing requires that answers to the questionnaire be highly structured. If a respon- 
dent gives an unacceptable answer (that is, one not precoded and programmed), the computer 
will reject it (see Research Snapshot above). 

Computer-assisted telephone interviewing systems include telephone management systems 
that select phone numbers, dial the numbers automatically, and perform other labor-saving func- 
tions. These systems can automatically control sample selection by randomly generating names 
or fulfilling a sample quota. A computer can generate an automatic callback schedule. A typical 
call management system might schedule recontact attempts to recall no answers after two hours 
and busy numbers after ten minutes and allow the interviewer to enter a more favorable time slot 
(day and hour) when a respondent indicates that he or she is too busy to be interviewed. Software 
systems also allow researchers to request daily status reports on the number of completed inter- 
views relative to quotas. CATI interviews can also be conducted by a prerecorded voice with the 
respondent answering by punching buttons on the phone. 


Computerized Voice-Activated Telephone Interview 


Technological advances have combined computerized telephone dialing and voice-activated com- 
puter messages to allow researchers to conduct telephone interviews without human interviewers. 
However, researchers have found that computerized voice-activated telephone interviewing 
works best with very short, simple questionnaires. One system includes a voice-synthesized mod- 
ule controlled by a microprocessor. With it the sponsor is able to register a caller’s single response 
such as “true/false,” “yes/no,” “like/dislike,” or “for/against.” This type of system has been used 
by television and radio stations to register callers’ responses to certain issues. One system, Telsol, 


© GEORGE DOYLE & CIARAN GRIFFIN 


Chapter 10: Survey Research: Communicating with Respondents 


begins with an announcement that the respondent is listening to a recorded message. The com- 
puter then asks questions, leaving blank tape in between to record the answers. If respondents do 
not answer the first two questions, the computer disconnects and goes to the next call. With this 
process, the entire data collection process can be automated because a recorded voice is used to 
both ask the questions and record answers. 


Global Considerations 


Different cultures often have different norms about proper telephone behavior. For example, 
business-to-business researchers have learned that Latin American businesspeople will not open 
up to strangers on the telephone. So, researchers in Latin America usually find personal interviews 
more suitable than telephone surveys. In Japan, respondents consider it ill-mannered if telephone 
interviews last more than 20 minutes. 


Self-Administered Questionnaires 


Many surveys do not require an interviewer’s presence. Researchers distribute questionnaires to 
consumers through the mail and in many other ways (see Exhibit 10.1). They insert questionnaires 
in packages and magazines. They may place questionnaires at points of purchase or in high-traffic 
locations in stores or malls. They may even fax questionnaires to individuals. Questionnaires can 
be printed on paper, but they may be posted on the Internet or sent via e-mail. No matter how 
the self-administered questionnaires are distributed, they are different from interviews because the 
respondent takes responsibility for reading and answering the questions. 


EXHIBIT 10.1 Self-Administered Questionnaires Can Be Either Printed or Electronic 
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self-administered 
questionnaires 


Surveys in which the respondent 
takes the responsibility for read- 
ing and answering the questions. 


Self-administered questionnaires present a challenge to the researcher because they rely on 
the clarity of the written word rather than on the skills of the interviewer. The nature of self- 
administered questionnaires is best illustrated by explaining mail questionnaires. 


Mail Questionnaires 


A mail survey is a self-administered questionnaire sent to respondents through the mail. This 
paper-and-pencil method has several advantages and disadvantages. 


GEOGRAPHIC FLEXIBILITY 


Mail questionnaires can reach a geographically dispersed sample simultaneously because inter- 
viewers are not required. Respondents (such as farmers) who are located in isolated areas or those 
(such as executives) who are otherwise difficult to reach can easily be contacted by mail. For 


mail survey 


A self-administered questionnaire 
sent to respondents through 
the mail. 
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example, a pharmaceutical firm may find that doctors are not available for personal or telephone 
interviews. However, a mail survey can reach both rural and urban doctors who practice in widely 
dispersed geographic areas. 


COST 


Mail questionnaires are relatively inexpensive compared with personal interviews, though they 
are not cheap. Most include follow-up mailings, which require additional postage and printing 
costs. And it usually isn’t cost-effective to try to cut costs on printing—questionnaires photo- 
copied on low-grade paper have a greater likelihood of being thrown in the wastebasket than 
those prepared with more expensive, high-quality printing. The low response rates contribute 
to the high cost. 


RESPONDENT CONVENIENCE 


Mail surveys and other self-administered questionnaires can be filled out when the respondents 
have time, so respondents are more likely to take time to think about their replies. Many hard- 
to-reach respondents place a high value on convenience and thus are best contacted by mail. In 
some situations, particularly in business-to-business research, mail questionnaires allow respon- 
dents to collect facts, such as employment statistics, that they may not be able to recall without 
checking. Being able to check information by verifying records or, in household surveys, by 
consulting with other family members should provide more valid, factual information than either 
personal or telephone interviews would allow. A catalog retailer may use mail surveys to estimate 
sales volume for catalog items by sending a mock catalog as part of the questionnaire. Respon- 
dents would be asked to indicate how likely they would be to order selected items. Using the 
mail allows respondents to consult other family members and to make their decisions within a 
reasonable time span. 


ANONYMITY OF RESPONDENT 


In the cover letter that accompanies a mail or self-administered questionnaire, researchers almost 
always state that the respondents’ answers will be confidential. Respondents are more likely to 
provide sensitive or embarrassing information when they can remain anonymous. For example, 
personal interviews and a mail survey conducted simultaneously asked the question “Have you 
borrowed money at a regular bank?” Researchers noted a 17 percent response rate for the personal 
interviews and a 42 percent response rate for the mail survey. Although random sampling error 
may have accounted for part of this difference, the results suggest that for research on personal and 
sensitive financial issues, mail surveys are more confidential than personal interviews. 

Anonymity can also reduce social desirability bias. People are more likely to agree with con- 
troversial issues, such as extreme political candidates, when completing self-administered ques- 
tionnaires than when speaking to interviewers on the phone or at their doorsteps. 


ABSENCE OF INTERVIEWER 


Although the absence of an interviewer can induce respondents to reveal sensitive or socially unde- 
sirable information, this lack of personal contact can also be a disadvantage. Once the respondent 
receives the questionnaire, the questioning process is beyond the researcher’s control. Although 
the printed stimulus is the same, each respondent will attach a different personal meaning to each 
question. Selective perception operates in research as well as in advertising. The respondent does 
not have the opportunity to question the interviewer. Problems that might be clarified in a per- 
sonal or telephone interview can remain misunderstandings in a mail survey. There is no inter- 
viewer to probe for additional information or clarification of an answer, and the recorded answers 
must be assumed to be complete. 

Respondents have the opportunity to read the entire questionnaire before they answer indi- 
vidual questions. Often the text of a later question will provide information that affects responses 
to earlier questions. 
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STANDARDIZED QUESTIONS 


Mail questionnaires typically are highly standardized, and the questions are quite structured. Ques- 
tions and instructions must be clear-cut and straightforward. Ambiguous questions only create 
additional error. Interviewing allows for feedback from the interviewer regarding the respondent’s 
comprehension of the questionnaire. An interviewer who notices that the first 50 respondents are 
having some difficulty understanding a question can report this fact to the research analyst so that 
revisions can be made. With a mail survey, however, once the questionnaires are mailed, it is dif- 
ficult to change the format or the questions. 


TIME IS MONEY 


If time is a factor in management’s interest in the research results, or if attitudes are rapidly 
changing (for example, toward a political event), mail surveys may not be the best communi- 
cation medium. A minimum of two or three weeks is necessary for receiving the majority of 
the responses. Follow-up mailings, which usually are sent when the returns begin to trickle in, 
require an additional two or three weeks. The time between the first mailing and the cut-off date 
(when questionnaires will no longer be accepted) normally is six to eight weeks. In a regional 
or local study, personal interviews can be conducted more quickly. However, conducting a 
national study by mail might be substantially faster than conducting personal interviews across 
the nation. 


LENGTH OF MAIL QUESTIONNAIRE 


Mail questionnaires vary considerably in length, ranging from extremely short postcard question- 
naires to multipage booklets that require respondents to fill in thousands of answers. A general rule 
of thumb is that a mail questionnaire should not exceed six pages in length. When a questionnaire 
requires a respondent to expend a great deal of effort, an incentive is generally required to induce 
the respondent to return the questionnaire. The following sections discuss several ways to obtain 
high response rates even when questionnaires are longer than average. 


Response Rates 


All questionnaires that arrive via bulk mail are likely to get thrown away. Questionnaires that 
are boring, unclear, or too complex are even more likely to get thrown in the wastebasket. A 
poorly designed mail questionnaire may be returned by less than 5 percent of those sampled (that 
is, a 5 percent response rate). The basic calculation for obtaining a response rate is to count the 
number of questionnaires returned or completed, then divide the total by the number of eligible 
people who were contacted or requested to participate in the survey. Typically, the number in 
the denominator is adjusted for faulty addresses and similar problems that reduce the number of 
eligible participants. 

The major limitations of mail questionnaires relate to response problems. Respondents who 
complete the questionnaire may not be typical of all people in the sample. Individuals with 
a special interest in the topic are more likely to respond to a mail survey than those who are 
indifferent. 

A researcher has no assurance that the intended subject is the person who fills out the question- 
naire. The wrong person answering the questions may be a problem when surveying corporate 
executives, physicians, and other professionals, who may pass questionnaires on to subordinates 
to complete. This probably is not unique to snail mail surveys since electronic surveying suffers 
similarly. 

Evidence suggests that cooperation and response rates rise as home value increases. Also, 
if the sample has a high proportion of retired and well-off householders, response rates will be 
lower. Mail survey respondents tend to be better educated than nonrespondents. If they return 
the questionnaire at all, poorly educated respondents who cannot read and write well may skip 
open-ended questions to which they are required to write out their answers. Rarely will a mail 
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who were asked to participate in 
the survey. 


222 


cover letter 


Letter that accompanies a ques- 
tionnaire to induce the reader 
to complete and return the 
questionnaire. 


Part 3: Research Methods for Collecting Primary Data 


survey have a 50 percent or greater response rate. However, the use of follow-up mailings and 
other techniques may increase the response rate to an acceptable percentage. The lower the 
response rate, the greater the concern that the resulting sample will not adequately represent 
the population. 


Increasing Response Rates for Mail Surveys 


Nonresponse error is always a potential problem with mail surveys. Individuals who are interested 
in the general subject of the survey are more likely to respond than those with less interest or little 
experience. Thus, people who hold extreme positions on an issue are more likely to respond than 
individuals who are largely indifferent to the topic. To minimize this bias, researchers have devel- 
oped a number of techniques to increase the response rate to mail surveys. For example, almost 
all surveys include postage-paid return envelopes. Using a stamped return envelope instead of a 
business reply envelope increases response rates even more." Designing and formatting attractive 
questionnaires and wording questions so that they are easy to understand also help ensure a good 
response rate. However, special efforts may be required even with a sound questionnaire. Several 
of these methods are discussed in the following subsections. 


COVER LETTER 


A cover letter that accompanies a questionnaire or is printed on the first page of the question- 
naire booklet is an important means of inducing a reader to complete and return the question- 
naire. Exhibit 10.2 illustrates a cover letter and some of the points considered by a research 
professional to be important in gaining respondents’ attention and cooperation. The first para- 
graph of the letter explains why the study is important. The basic appeal alludes to the social 
usefulness of responding. Two other frequently used appeals are asking for help (“Will you do 
us a favor?”) and the egotistical appeal (“Your opinions are important!”). Most cover letters 
promise confidentiality, invite the recipient to use an enclosed postage-paid reply envelope, 
describe any incentive or reward for participation, explain that answering the questionnaire will 
not be difficult and will take only a short time, and describe how the person was scientifically 
selected for participation. 

A personalized letter addressed to a specific individual shows the respondent that he or she is 
important. Including an individually typed cover letter on letterhead rather than a printed form is 
an important element in increasing the response rate in mail surveys.'! 


MONEY HELPS 


The respondent’s motivation for returning a questionnaire may be increased by offering mon- 
etary incentives or premiums. Although pens, lottery tickets, and a variety of premiums have 
been used, monetary incentives appear to be the most effective and least biasing incentive. 
Money attracts attention and creates a sense of obligation. Perhaps for this reason, monetary 
incentives work for all income categories. Often, cover letters try to boost response rates with 
messages such as “We know that the attached dollar cannot compensate you for your time but 
please accept it as a token of our appreciation.” Response rates increase dramatically when the 
monetary incentive is to be sent to a charity of the respondent’s choice rather than directly to 
the respondent. 


INTERESTING QUESTIONS 


The topic of the research—and thus the point of the questions—cannot be manipulated without 
changing the definition of the research problem. However, certain interesting questions can be 
added to the questionnaire, perhaps at the beginning, to stimulate respondents’ interest and to 
induce cooperation. By including questions that are of little concern to the researchers but that 
the respondents want to answer, the researchers may give respondents who are indifferent to the 
major questions a reason for responding. 
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Market Research Leaders 


Component: — 111 Eustice Square, 
Terroir, IL 39800-7600 


Respondents  —» Mr. Griff Mitchell 
Address 821 Shrewsbury Ave 
Hector Chase, LA 70809 


Dear Mr. Mitchell: 
Request/Time —» We'd like your input as part of a study of family media habits. This study is not involved 


involved in any attempt to sell anything. Rather, the results will help provide better media options 
for families. The survey typically takes about 12 minutes to complete. 


Selection — You were selected based on a random sample of home owners living in the 70809 zip 
Method code. 

Reason to — We need your opinion about many important issues involving the way modern families 
Respond interact with various media including print, television, radio, and Internet sources. 


Companies need input to create the most appealing and useful options for consumers; 
and local, state, and federal agencies need input to know what types of regulations, if 
any, are most appropriate. Without the opinions of people like you, many of these key 
issues will likely not be resolved. 


Confidentiality) — The information you provide, just as with all the information collected within the 

IRB Approval scope of this project, will be entirely confidential. It will only be used for the purpose 
of this research and no individuals will be identified within the data. Additionally, this 
survey and the request for you to participate has been reviewed and approved by the 
Institutional Review Board of MKTR which monitors all research conducted and assures 
that procedures are consistent with ethical guidelines for federally funded research 
(although this particular project is not funded federally). If you have any questions, the 
MKTR IRB can be contacted at (888) 555-8888. 


Incentive — Your response will improve the media choices that your family faces. In addition, a $10 
check that you can cash at your personal bank is included as a token of our appreciation. 


Willingness — Additionally, you can direct any questions about this project directly to me. The contact 
to answer information is available at the top of this letter. Additionally, we will be happy to provide 
questions you a summary of the results. Simply complete the enclosed self-addressed postcard 


and drop it in the mail or include it with the completed questionnaire. A self-addressed, 
postage paid reply envelope is included for your return. 


Thanks — Again, thank you so much for your time and for sharing your opinions. 


Signature => Cg Nihode gue 


FOLLOW-UPS 


Most mail surveys generate responses in a pattern like that shown in Exhibit 10.3 on the next 
page, which graphs the cumulative response rates for two mail surveys. The response rates are 
relatively high for the first two weeks (as indicated by the steepness of each curve), then the 
rates gradually taper off. 

After responses from the first wave of mailings begin to trickle in, most studies use a follow- 
up letter or postcard reminder, which request that the questionnaire be returned because a 
100-percent return rate is important. A follow-up may include a duplicate questionnaire or may 
merely be a reminder to return the original questionnaire. Multiple contacts almost always 
increase response rates. The more attempts made to reach people, the greater the chances of their 
responding.” 

Both of the studies in Exhibit 10.3 used follow-ups. Notice how the cumulative response rates 
picked up around week four. 
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Plots of Actual Response 
Patterns for Two 
Commercial Surveys 


Mail surveys can reach a 
geographically dispersed 
sample and are relatively 
inexpensive. One disadvantage 
is the length of time involved 
in getting responses back. 
Response rates themselves also 
offer a challenge to surveyors. 
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ADVANCE NOTIFICATION 


Advance notification, by either letter or telephone, that a questionnaire will be arriving has been 
successful in increasing response rates in some situations. ACNielsen has used this technique to 
ensure a high cooperation rate in filling out diaries of television watching. Advance notices that 
go out closer to the questionnaire mailing time produce better results than those sent too far 
in advance. The optimal lead time for advance notification is three days before the mail survey is 
to arrive. 


SURVEY SPONSORSHIP 


Auspices bias may result from the sponsorship of a survey. One business-to-business researcher 
wished to conduct a survey of its wholesalers to learn their stocking policies and their attitudes 
concerning competing manufacturers. A mail questionnaire sent on the corporate letterhead very 
likely would have received a much lower response rate than the questionnaire actually sent, which 
used the letterhead of a commercial marketing research firm. Sponsorship by well-known and pres- 
tigious organizations such as universities or government agencies may also significantly influence 

response rates. A mail survey sent 


ug 
i 


to members of a consumer panel 
will receive an exceptionally high 
response rate because panel mem- 
bers have already agreed to coop- 
erate with surveys. 


OTHER TECHNIQUES 


Numerous other devices have 
been used for increasing response 
rates. For example, the type of 
postage (commemorative versus 
regular stamp), envelope size, 
color of the questionnaire paper, 
and many other factors have 
been varied in efforts to increase 
response rates. Each has had at 
least limited success in certain 
situations; unfortunately, under 
other conditions each has failed to 
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increase response rates significantly. The researcher should consider his or her particular situation. 
For example, the researcher who is investigating consumers faces one situation; the researcher 
who is surveying corporate executives faces quite another. 


KEYING MAIL QUESTIONNAIRES WITH CODES 


A researcher planning a follow-up letter or postcard should not disturb respondents who already 
have returned the questionnaire. The expense of mailing questionnaires to those who already have 
responded is usually avoidable. One device for eliminating those who have already responded 
from the follow-up mailing list is to mark the questionnaires so that they may be keyed to iden- 
tify members of the sampling frame who are nonrespondents. Blind keying of questionnaires 
on a return envelope (systematically varying the job number or room number of the marketing 
research department, for example) or a visible code number on the questionnaire has been used for 
this purpose. Visible keying is indicated with statements such as “The sole purpose of the number 
on the last page is to avoid sending a second questionnaire to people who complete and return the 
first one.” Ethical researchers key questionnaires only to increase response rates, thereby preserv- 
ing respondents’ anonymity. 


Global Considerations 


Researchers conducting surveys in more than one country must recognize that postal services 
and cultural circumstances differ around the world. Some of the issues to consider are the reli- 
ability of mail delivery, literacy rates, and trust that researchers can and will provide confiden- 
tiality. In some cases, hand delivery of surveys or door-to-door interviewing may be necessary. 
In other cases, consumers (especially women or children) might be discouraged from talking 
to an interviewer who is not a family member, so mailed questionnaires would be superior to 
interviews. 


Self-Administered Questionnaires 
Using Other Forms of Distribution 


Many forms of self-administered, printed questionnaires are very similar to mail questionnaires. 
Airlines frequently pass out questionnaires to passengers during flights. Restaurants, hotels, and 
other service establishments print short questionnaires on cards so that customers can evaluate the 
service. Tennis Magazine, Advertising Age, Wired, and many other publications have used inserted 
questionnaires to survey current readers inexpensively, and often the results provide material for 
a magazine article. 

Many manufacturers use their warranty or owner registration cards to collect demographic infor- 
mation and data about where and why products were purchased. Using owner registration cards is 
an extremely economical technique for tracing trends in consumer habits. Again, problems may arise 
because people who fill out these self-administered questionnaires differ from those who do not. 

Extremely long questionnaires may be dropped off by an interviewer and then picked up later. 
The drop-off method sacrifices some cost savings because it requires traveling to each respondent’s 
location. 


Fax Surveys 


With fax surveys, potential survey respondents receive and/or return questionnaires via fax 
machines." A questionnaire inserted in a magazine may instruct the respondent to clip out 
the questionnaire and fax it to a certain phone number. In a mail survey, a prepaid-postage 
envelope places little burden on the respondent. But faxing a questionnaire to a long-distance 
number requires that the respondent pay for the transmission of the fax. Thus, a disadvantage 
of the fax survey is that only respondents with fax machines who are willing to exert the extra 
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effort will return questionnaires. Again, people with extreme opinions will be more likely 
to respond. 

To address this disadvantage, marketers may use faxing as one of several options for replying to 
a survey. Recently, the journal American Family Physician carried a reader survey that gave respon- 
dents the option of either returning the reply by fax or visiting the journal’s Web site to answer 
the same questions online.'* For busy physicians who likely have access to office equipment, this 
approach would improve the response rate. 

Fax machines can also be used to distribute questionnaires. These fax surveys reduce the 
sender’s printing and postage costs and can be delivered and returned faster than traditional mail 
surveys. Questionnaires distributed via fax can deal with timely issues. Although few households 
have fax machines, when the sample consists of organizations that are likely to have fax machines, 
the sample coverage may be adequate. 


E-Mail Surveys 


Questionnaires can be distributed via e-mail, but researchers must remember that some individuals 
cannot be reached this way. Certain projects do lend themselves to e-mail surveys, such as internal 
surveys of employees or satisfaction surveys of retail buyers who regularly deal with an organiza- 
tion via e-mail. The benefits of incorporating a questionnaire in an e-mail include the speed of 
distribution, lower distribution and processing costs, faster turnaround time, more flexibility, and 
less handling of paper questionnaires. The speed of e-mail distribution and the quick response time 
can be major advantages for surveys dealing with time-sensitive issues. 

Not much academic research has been conducted on e-mail surveys. Nevertheless, some 
researchers have argued that many respondents feel they can be more candid in e-mail than in 
person or on the telephone, for the same reasons they are candid on other self-administered 
questionnaires. Yet in many organizations employees know that their e-mails are not secure 
and “eavesdropping” by a supervisor could possibly occur. Further, maintaining respondents’ 
anonymity is difficult, because a reply to an e-mail message typically includes the sender’s 
address. Researchers designing e-mail surveys should assure respondents that their answers will 
be confidential. 

Not all e-mail systems have the same capacity: Some handle color and graphics well; others are 
limited to text. The extensive differences in the capabilities of respondents’ computers and e-mail 
software limit the types of questions and the layout of the e-mail questionnaire. For example, the 
display settings for computer screens vary widely, and wrap-around of lines may put the questions 
and the answer choices into strange and difficult-to-read patterns. Many novice e-mail users find it 
difficult to mark answers in brackets on an e-mail questionnaire and/or to send a completed ques- 
tionnaire using the e-mail reply function. For this reason, some researchers give respondents the 
option to print out the questionnaire, complete it in writing, and return it via regular mail. Unless 
the research is an internal organizational survey, this alternative, of course, requires the respondent 
to pay postage. 

In general, the guidelines for printed mail surveys apply to e-mail surveys. However, some 
differences exist, because the cover letter and the questionnaire appear in a single e-mail mes- 
sage. A potential respondent who is not immediately motivated to respond, especially one who 
considers an unsolicited e-mail survey to be spam, can quickly hit the delete button to remove 
the e-mail. This response suggests that e-mail cover letters should be brief and the question- 
naires relatively short. The cover letter should explain how the company got the recipient’s 
name and should include a valid return e-mail address in the “from” box and reveal who is 
conducting the survey. Also, if the e-mail lists more than one address in the “to” or “CC” field, 
all recipients will see the entire list of names. This lack of anonymity has the potential to cause 
response bias and nonresponse error. When possible, the e-mail should be addressed to a single 
person. (The blind carbon copy, or BCC, field can be used if the same message must be sent to 
an entire sample.) 

E-mail has another important role in survey research. E-mail letters can be used as cover letters 
asking respondents to participate in an Internet survey. Such e-mails typically provide a password 
and a link to a unique Web site location that requires a password for access. 
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Internet Surveys 


An Internet survey is a self-administered questionnaire posted on a Web site. Respondents 
provide answers to questions displayed onscreen by highlighting a phrase, clicking an icon, or 
keying in an answer. Like every other type of survey, Internet surveys have both advantages and 
disadvantages. 


SPEED AND COST-EFFECTIVENESS 


Internet surveys allow researchers to reach a large audience (possibly a global one), personalize 
individual messages, and secure confidential answers quickly and cost-effectively. These 
computer-to-computer self-administered questionnaires eliminate the costs of paper, postage, 
and data entry, as well as other administrative costs. Once an Internet questionnaire has been 
developed, the incremental cost of reaching additional respondents is minimal. So, samples can 
be larger than with interviews or other types of self-administered questionnaires. Even with large 
samples, surveys that used to take many weeks can be conducted in a week or less. 


VISUAL APPEAL AND INTERACTIVITY 


Surveys conducted on the Internet can be interactive. The researcher can use more sophisticated 
lines of questioning based on the respondents’ prior answers. Many of these interactive surveys 
utilize color, sound, and animation, which may help to increase respondents’ cooperation and 
willingness to spend time answering the questionnaires. The Internet is an excellent medium 
for the presentation of visual materials, such as photographs or drawings of product prototypes, 
advertisements, and movie trailers. Innovative measuring instruments that take advantage of the 
ability to adjust backgrounds, fonts, color, and other features have been designed and applied with 
considerable success. 


RESPONDENT PARTICIPATION AND COOPERATION 


Participation in some Internet surveys occurs because computer users intentionally navigate to a 
particular Web site where questions are displayed. For example, a survey of more than 10,000 
visitors to the Ticketmaster Web site helped Ticketmaster better understand its customer pur- 
chase patterns and evaluate visitor satisfaction with the site. In some cases, individuals expect to 
encounter a survey at a Web site; in others, it is totally unexpected. In some instances, the visi- 
tor cannot venture beyond the survey page without providing information for the organization’s 
“registration” questionnaire. When the computer user does not expect a survey on a Web site and 
participation is voluntary, response rates are low. And, as with other questionnaires that rely on 
voluntary self-selection, participants tend to be more interested in or involved with the subject of 
the research than the average person. 

For many other Internet surveys, respondents are initially contacted via e-mail. Often they are 
members of consumer panels who have previously indicated their willingness to cooperate. When 
panel members receive an e-mail invitation to participate, they are given logon instructions and 
a password. This security feature prevents access by individuals who are not part of the scientifi- 
cally selected sample. Assigning a unique password code also allows the researchers to track the 
responses of each respondent, thereby identifying any respondent who makes an effort to answer 
the questionnaire more than once. 

Panel members also need an incentive to respond. A study of German consumers showed that 
nothing beat financial incentives. In other words, the best way to get responses was to simply pay 
consumers for participating in surveys." 

Ideally, the welcome screen contains the name of the research company and information about 
how to contact the organization if the respondent has a problem or concern. A typical statement 
might be “If you have any concerns or questions about this survey or if you experience any tech- 
nical difficulties, please contact [name of research organization].” 
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A self-administered questionnaire 
posted on a Web site. 
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The first Web page in an internet 
survey, which introduces the sur- 
vey and requests that the respon- 
dent enter a password or pin. 


Who Are You? (and What Do You Listen to?) The results clearly indicate the value of 


“Who are you?” is acommon question with people online. The online social networking sites as a potential 
advent of online social networking sites, such as Facebook, revenue stream, through the marketing of 
MySpace, and Bebo have revealed an unintended benefit for digital music through these mediums. Two of 


digital music. For many, the music that is tagged to your profile is every five social networkers have embedded 
part of who you are—and is a reflection of the kind of personality music in their profile. For MySpace, the percent- 


you have. age of embedded music is even higher (more than 60 percent). 
What does this mean for digital music? In 2007, Additionally, more than a quarter of the social networkers state that 
Entertainment Media Research (EMR) and Olswang conducted they regularly discover music that they love on the social network. 
an online survey, which lasted over 20 minutes, to a sample Clearly, there are many potential opportunities for music 
of 1,700 U.K. respondents who are part of the larger sample of publishers in this growing market, and the use of an online sur- 
300,000 panelists in the EMR music consumer database. The vey to capture these trends was one way that EMR and Olswang 
online survey was deemed to be the most efficient means of were able to discover this interesting trend. If you are a part of an 
capturing detailed informa- online social network, perhaps you also use a person's music as a 


tion on music downloading way of discovering “Who are you?” 


(both legal and illegal), and Source: Ruppert, P., R. Hart, S. Evans, & J. Enser, 2007 Digital Music Survey, a product 
the sources of music for these of Entertainment Media Research in association with Olswang, Ltd. 


respondents. 
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REPRESENTATIVE SAMPLES 


The population to be studied, the purpose of the research, and the sampling methods determine 
the quality of Internet samples, which varies substantially. If the sample consists merely of those 
who visit a Web page and voluntarily fill out a questionnaire, then it is not likely to be representa- 
tive of the entire U.S. population, because of self-selection error. However, if the purpose of the 
research is to evaluate how visitors feel about a Web site, randomly selecting every 100th visitor 
may accomplish the study’s purpose. Scientifically drawn samples from a consumer panel, similar 
to what was done for the Digital Music Survey discussed above, or samples randomly generated in 
other ways also can be representative. 

Of course, a disadvantage, albeit ever decreasing, of Internet surveys is that many individuals 
in the general population cannot access the Internet. Even among people with Internet access, 
not all of them have the same level of technology. Many people with low-speed Internet con- 
nections (low bandwidth) cannot quickly download high-resolution graphic files. Many lack 
powerful computers or software that is compatible with advanced features programmed into 
many Internet questionnaires. Some individuals have minimal computer skills. They may not 
know how to navigate through and provide answers to an Internet questionnaire. For example, 
the advanced audio- and video-streaming technology of RealPlayer or Windows Media Player 
software can be used to incorporate a television commercial and questions about its effective- 
ness into an Internet survey. However, some respondents might find downloading the file too 
slow or even impossible, others might not have the RealPlayer or Windows Media Player 
software, and still others might not know how to use the streaming media software to view the 
commercial. 

For the foreseeable future, Internet surveys sampling the general public should be designed 
with the recognition that problems may arise for the reasons just described. Thus, photographs, 
animation, or other cutting-edge technological features created on the researcher’s/Web designer’s 
powerful computer may have to be simplified or eliminated so that all respondents can interact at 
the same level of technological sophistication. 

Because Internet surveys can be accessed anytime (24/7) from anywhere, they can reach 
certain hard-to-reach, busy respondents such as doctors, who would be almost impossible to reach 
via the telephone. 
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ACCURATE REAL-TIME DATA CAPTURE 


The computer-to-computer nature of Internet surveys means that each respondent’s answers are 
entered directly into the researcher’s computer as soon as the questionnaire is submitted. In addi- 
tion, the questionnaire software may be programmed to reject improper data entry. For example, 
on a paper questionnaire a respondent might incorrectly check two responses even though the 
instructions call for a single answer. In an Internet survey, this mistake can be interactively cor- 
rected as the survey is taking place. Thus, the data capture is more accurate than when humans 
are involved. 

Real-time data capture allows for real-time data analysis. A researcher can review up-to-the- 
minute sample size counts and tabulation data from an Internet survey in real time. 


CALLBACKS 


When the sample for an Internet survey is drawn from a consumer panel, those who have not 
completed the survey questionnaire can be easily recontacted. Computer software can simply 
automatically send e-mail reminders to panel members who did not visit the welcome page. 
Computer software can also identify the passwords of respondents who completed only a por- 
tion of the questionnaire and send those people customized messages. Sometimes such e-mails 
offer additional incentives to those individuals who terminated the questionnaire with only a few 
additional questions to answer, so that they are motivated to comply with the request to finish the 
questionnaire. 


PERSONALIZED AND FLEXIBLE QUESTIONING 


Computer-interactive Internet surveys are programmed in much the same way as computer- 
assisted telephone interviews. That is, the software that is used allows questioning to branch off 
into two or more different lines depending on a respondent’s answer to a filtered question. The 
difference is that there is no interviewer. The respondent interacts directly with software on a 
Web site. In other words, the computer program asks questions in a sequence determined by the 
respondent’s previous answers. The questions appear on the computer screen, and answers are 
recorded by simply pressing a key or clicking an icon, thus immediately entering the data into the 
computer’s memory. Of course, these methods avoid labor costs associated with data collection 
and processing of paper-and-pencil questionnaires. 

This ability to sequence questions based on previous responses is a major advantage of 
computer-assisted surveys. The computer can be programmed to skip from question 6 to 
question 9 if the answer to question 6 is no. Furthermore, responses to previous questions can 
lead to questions that can be personalized for individual respondents (for example, “When 
you cannot buy your favorite brand, Revlon, what brand of lipstick do you prefer?”). Often 
the respondent’s name appears in questions to personalize the questionnaire. Fewer and more 
relevant questions speed up the response process and increase the respondent’s involvement 
with the survey. 

A related advantage of using a Web survey is that it can prompt respondents when they skip 
over a question. In a test comparing telephone and Internet versions of the same survey, the rate of 
item nonresponse was less for the Internet version, which issued a prompt for each item that was 
left blank.” This was likely not a simple matter of motivation, because the rate of respondents who 
actually took the Web version was less than for the telephone version, even though the researchers 
offered a larger incentive to those who were asked to go online. (An earlier telephone screening 
had verified that everyone who was asked to participate had a computer.) 

The ability to customize questions and the low cost per recipient also help researchers keep 
surveys short, an important consideration for boosting responses.'* Jakob Nielsen, a consultant on 
Internet usability with the Nielsen Norman Group, emphasizes that “quick and painless” surveys 
generate the highest response and urges researchers to keep surveys as short as possible. He suggests 
that if the research objectives call for a long survey, the questions can be divided among several 
questionnaires, with each version sent to a different group of respondents. 
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dialog boxes 


Windows that open on a com- 
puter screen to prompt the user 
to enter information. 
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Designers of Internet questionnaires can be creative and flexible in the presentation of ques- 
tions by using a variety of dialog boxes, or windows that prompt the respondent to enter informa- 
tion. Chapter 15 discusses electronic questionnaire design and layout further. 


RESPONDENT ANONYMITY 


Respondents are more likely to provide sensitive or embarrassing information when they can 
remain anonymous. The anonymity of the Internet encourages respondents to provide honest 
answers to sensitive questions. 


RESPONSE RATES 


The methods for improving response rates for an Internet survey are similar to those for other 
kinds of survey research. A personalized invitation may be important. In many cases, the invitation 
is delivered via e-mail. The respondents may not recognize the sender’s address, so the message’s 
subject line is critical.'? The subject line should refer to a topic likely to interest the audience, 
and legal as well as ethical standards dictate that it may not be deceptive. Thus, the line might be 
worded in a way similar to the following: “Please give your opinion on [subject matter of inter- 
est].” Researchers should avoid gimmicks like dollar signs and the word free, either of which is 
likely to alert the spam filters installed on most computers. 

As mentioned earlier, with a password system, people who have not participated in a survey in 
a predetermined period of time can be sent a friendly e-mail reminder asking them to participate 
before the study ends. This type of follow-up, along with preliminary notification, interesting 
early questions, and variations of most other techniques for increasing response rates to mail ques- 
tionnaires, is recommended for Internet surveys. 

Unlike mail surveys, Internet surveys do not offer the opportunity to send a physical incen- 
tive, such as a dollar bill, to the respondent. Incentives to respond to a survey must be in the 
form of a promise of a future reward—for example, “As a token of appreciation for completing 
this survey, the sponsor of the survey will make a sizable contribution to a national charity. 
You can vote for your preferred charity at the end of the survey.” Although some researchers 
have had success with promising incentives, academic research about Internet surveys is sparse, 
and currently there are few definitive answers about the most effective ways to increase response 
rates. 


SECURITY CONCERNS 


Many organizations worry that hackers or competitors may access Web sites to discover new 
product concepts, new advertising campaigns, and other top-secret ideas. Respondents may 
worry whether personal information will remain private. So may the organizations sponsoring 
the research. Recently, McDonald’s conducted quality-control research in England and Scotland, 
automating the transmittal of data with a system in which consultants used handheld devices and 
sent the numbers to headquarters as e-mail messages. The system saved hours of work, but the 
company worried that confidential information could be compromised. McDonald’s therefore 
purchased software that encrypted the data and allowed the handhelds to be remotely wiped clean 
of data if they were lost or stolen.” 

As in the experience of McDonald’s, no system can be 100 percent secure, but risks 
can be minimized. Many research service suppliers specializing in Internet surveying have 
developed password-protected systems that are very secure. One important feature of these 
systems restricts access and prevents individuals from filling out a questionnaire over and over 
again. 


Kiosk Interactive Surveys 


A computer with a touch screen may be installed in a kiosk at a trade show, at a professional 
conference, in an airport, or in any other high-traffic location to administer an interactive survey. 
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Because the respondent chooses to interact with an on-site computer, self-selection often is a 
problem with this type of survey. Computer-literate individuals are most likely to complete these 
interactive questionnaires. At temporary locations such as conventions, these surveys often require 
a fieldworker to be at the location to explain how to use the computer system. This personal 
assistance is an obvious disadvantage. 


Survey Research That Mixes Modes 


For many surveys, research objectives dictate the use of some combination of telephone, mail, 
e-mail, Internet, and personal interview. For example, the researcher may conduct a short tele- 
phone screening interview to determine whether respondents are eligible for recontact in a more 
extensive personal interview. Such a mixed-mode survey combines the advantages of the telephone 
survey (such as fast screening) and those of the personal interview. A mixed-mode survey can 
employ any combination of two or more survey methods. Conducting a research study in two or 
more waves, however, creates the possibility that some respondents will no longer cooperate or 
will be unavailable in the second wave of the survey. 

Several variations of survey research use cable television channels. For example, a telephone 
interviewer calls a cable subscriber and asks him or her to tune in to a particular channel at a cer- 
tain time. An appointment is made to interview the respondent shortly after the program or visual 
material is displayed. NBC uses this type of mixed-mode survey to test the concepts for many 
proposed new programs. 


Text-Message Surveys 


Yes, surveys are even being sent via text messages. These may use the SMS (short message 
service) or MMS (multimedia message service). This technique is perhaps the newest survey 
approach. It has all the advantages of mobile phone surveys in terms of reach and it also shares 
the disadvantages in terms of reaching respondents who have not opted in via a mobile phone. 
However, text-message surveys are catching on in other countries and are ideal for surveys 
involving only a few very short questions. Additionally, MMS messages can include graphic 
displays or even short videos. This technology is likely to see more applications in the near 
future. 


Selecting the Appropriate 
Survey Research Design 


Earlier discussions of research design and problem definition emphasized that many research tasks 
may lead to similar decision-making information. There is no best form of survey; each has 
advantages and disadvantages. A researcher who must ask highly confidential questions may use a 
mail survey, thus sacrificing speed of data collection to avoid interviewer bias. If a researcher must 
have considerable control over question phrasing, central location telephone interviewing may be 
appropriate. 

To determine the appropriate technique, the researcher must ask several questions: Is the assis- 
tance of an interviewer necessary? Are respondents interested in the issues being investigated? Will 
cooperation be easily attained? How quickly is the information needed? Will the study require a 
long and complex questionnaire? How large is the budget? The criteria—cost, speed, anonymity, 
and so forth—may differ for each project. 

Exhibit 10.4 on the next page summarizes the major advantages and disadvantages of typi- 
cal door-to-door, mall intercept, telephone, mail, and Internet surveys. It emphasizes the typi- 
cal types of surveys. For example, a creative researcher might be able to design highly versatile 
and flexible mail questionnaires, but most researchers use standardized questions. An elaborate 
mail survey may be far more expensive than a short personal interview, but generally this is 
not the case. 


231 


mixed-mode survey 


Study that employs any combi- 
nation of survey methods. 


he 


—Publius Syrus, 
Circa 42 BC 
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Advantages and Disadvantages of Typical Survey Methods 


Door-to-Door 
Personal 
Interview 


Mall Intercept 
Personal 
Interview 


Telephone 
Interview 


Internet 
Survey 


Speed of data 
collection 


Geographic 
flexibility 


Respondent 
cooperation 


Versatility of 
questioning 


Questionnaire 
length 


Item non- 
response rate 


Possibility for 


respondent 
misunderstanding 


Degree of inter- 
viewer influence 
on answers 


Supervision of 
interviewers 


Anonymity of 
respondent 


Ease of callback 
or follow-up 


Cost 


Special features 


Moderate to fast 


Limited to 
moderate 


Excellent 


Quite versatile 


Long 


Low 


Low 


High 


Moderate 


Low 


Difficult 


Highest 


Visual materials 
may be shown or 
demonstrated; 
extended 
probing possible 


Fast 


Confined, 
possible urban 
bias 


Moderate to low 


Extremely 
versatile 


Moderate to 


long 


Medium 


Low 


High 


Moderate to 
high 


Low 


Difficult 


Moderate to 
high 


Taste tests, 
viewing of TV 
commercials 
possible 


Very fast 


High 


Good 


Moderate 


Moderate 


Medium 


Average 


Moderate 


High, especially 
with central- 
location 
interviewing 


Moderate 


Easy 


Low to moderate 


Fieldwork and 
supervision of 
data collection 
are simplified; 
quite adaptable 
to computer 
technology 


Slow; researcher 
has no control 
over return of 
questionnaire 


High 


Moderate; 
poorly designed 
questionnaire 
will have low 
response rate 


Not versatile; 
requires highly 
standardized 
format 


Varies 
depending on 
incentive 


High 


High; no 

interviewer 
present for 
clarification 


None; 
interviewer 
absent 


Not applicable 


High 


Easy, but takes 
time 


Lowest 


Respondent 

may answer 
questions at own 
convenience; 
has time to 
reflect on 
answers 


Instantaneous; 
24/7 


High 
(worldwide) 


Varies 
depending on 
Web site; high 
from consumer 
panels 


Extremely 
versatile 


Moderate; 
length 
customized 
based on 
answers 


Software can 
assure none 


High 


None 


Not applicable 


Respondent can 
be either anony- 
mous or known 


Difficult, unless 
e-mail address is 
known 


Low 


Streaming media 
software allows 
use of graphics 
and animation 


Note: The emphasis is on typical surveys. For example, an elaborate mail survey may be far more expensive than a short personal interview, but this generally is not 


the case. 
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e Interpretative research involving a 
survey generally requires an interactive 
approach. On occasion, respondents may 
simply be asked to write a story without any 
elaboration, but generally, particularly with phe- 
nomenology, the researcher and the respondent are 
actively engaged. 


e The longer the questionnaire, the lower the response rate. 
e When long questionnaires are absolutely necessary, the 
researcher should: 
- Look for respondents who are essentially a captive 


- Try to target the survey toward individuals who are 
highly involved in the topic 
- Use a survey research panel 


E-mail surveys and Internet surveys are good approaches for 

most types of surveys. 

e When a panel or special interest group provides 
responses, the researcher should be extra vigilant for 
bogus response patterns. 

e Good response rates with no true special consider- 
ations such as a very high incentive or extreme levels of 
involvement can be expected to be between 10 and 


audience; like students in a class 15 percent. 
- Offer a nontrivial incentive to respond 


Pretesting 


A researcher who is surveying 3,000 consumers does not want to find out after the questionnaires 
have been completed or returned that most respondents misunderstood a particular question, 
skipped a series of questions, or misinterpreted the instructions for filling out the questionnaire. To 
avoid problems such as these, screening procedures, or pretests, are often used. Pretesting involves 
a trial run with a group of respondents to iron out fundamental problems in the instructions or 
design of a questionnaire. The researcher looks for such obstacles as the point at which respondent 
fatigue sets in and whether there are any particular places in the questionnaire where respondents 
tend to terminate. Unfortunately, this stage of research is sometimes eliminated because of costs 
or time pressures. 

Broadly speaking, three basic ways to pretest exist. The first two involve screening the 
questionnaire with other research professionals, and the third—the one most often called pre- 
testing—is a trial run with a group of respondents. When screening the questionnaire with 
other research professionals, the investigator asks them to look for such problems as difficulties 
with question wording, leading questions, and bias due to question order. An alternative type 
of screening might involve a client or the research manager who ordered the research. Often, 
managers ask researchers to collect information, but when they see the questionnaire, they find 
that it does not really meet their needs. Only by checking with the individual who has requested 
the questionnaire does the researcher know for sure that the information needed will be pro- 
vided. Once the researcher has decided on the final questionnaire, data should be collected with 
a small number of respondents (perhaps 100) to determine whether the questionnaire needs 
refinement. 


Ethical Issues in Survey Research 


Many ethical issues apply to survey research, such as respondents’ right to privacy, the use of 
deception, respondents’ right to be informed about the purpose of the research, the need for con- 
fidentiality, the need for honesty in collecting data, and the need for objectivity in reporting data. 
You may wish to reexamine Chapter 5’s coverage of these issues now that various survey research 
techniques have been discussed.’! 


pretesting 


Screening procedure that 


involves a trial run with a group 
of respondents to iron out fun- 
damental problems in the survey 


design. 
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Summary 


1. Summarize ways researchers gather information through interviews. Interviews can be cat- 
egorized based on the medium used to communicate with respondents. Interviews can be 
conducted door-to-door, in shopping malls, or on the telephone. Traditionally, interviews 
have been recorded using paper and pencil, but survey researchers are increasingly using 
computers. Personal interviews are a flexible method that allows researchers to use visual aids 
and various kinds of props. However, the presence of an interviewer may influence subjects’ 
responses. 


2. Compare the advantages and disadvantages of conducting door-to-door, mall intercept, and tele- 
phone interviews. Door-to-door personal interviews can get high response rates, but they are 
more costly to administer than other types of surveys. When a sample need not represent the 
entire country, mall intercept interviews may reduce costs. Telephone interviewing has the 
advantage of providing data fast and at a lower cost per interview. However, not all households 
have telephones, and not all telephone numbers are listed in directories. This causes problems in 
obtaining a representative sample, so researchers often use random digit dialing. Absence of face- 
to-face contact and inability to use visual materials also limit telephone interviewing. Computer- 
assisted telephone interviewing from central locations can improve the efficiency of certain kinds 
of telephone surveys. 


3. Evaluate the advantages and disadvantages of distributing questionnaires through the mail, the 
Internet, and by other means. Traditionally, self-administered questionnaires have been dis- 
tributed by mail, but self-administered questionnaires also may be dropped off to individual 
respondents, distributed from central locations, or administered via computer. Mail question- 
naires generally are less expensive than telephone or personal interviews, but they also intro- 
duce a much larger chance of nonresponse error. Several methods can be used to encourage 
higher response rates. Mail questionnaires must be more structured than other types of surveys 
and cannot be changed if problems are discovered in the course of data collection. The Internet 
and other interactive media provide convenient ways for organizations to conduct surveys. 
Internet surveys are quick and cost-effective, but not everyone has Internet access. Because 
the surveys are computerized and interactive, questionnaires can be personalized and data can 
be captured in real time. Some privacy and security concerns exist, but the future of Internet 
surveys looks promising. 


4. Discuss the importance of pretesting questionnaires. Pretesting a questionnaire on a small sample 
of respondents is a useful way to discover problems while they can still be corrected. Pretests may 
involve screening the questionnaire with other research professionals or conducting a trial run 
with a set of respondents. 


5. Describe ethical issues that arise in survey research. Researchers must protect the public from 
misrepresentation and exploitation. This obligation includes honesty about the purpose of a 
research project and protection of subjects’ right to refuse to participate or to answer particular 
questions. Researchers also should protect the confidentiality of participants and record responses 
honestly. 


Key Terms and Concepts 


callbacks, 213 e-mail surveys, 226 pretesting, 233 
central location interviewing, 217 fax survey, 225 random digit dialing, 217 
computer-assisted telephone interviewing Internet survey, 227 response rate, 221 

(CATI), 218 item nonresponse, 211 self-administered questionnaires, 219 
cover letter, 222 mail survey, 219 telephone interviews, 214 
dialog boxes, 230 mall intercept interviews, 213 welcome screen, 227 


door-to-door interviews, 212 
drop-off method, 225 


mixed-mode survey, 231 
personal interview, 209 
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Questions for Review and Critical Thinking 


. What type of communication medium would you use to con- 

duct the following surveys? Why? 

a. Survey of the buying motives of industrial engineers 

b. Survey of the satisfaction levels of hourly support staff 

c. Survey of television commercial advertising awareness 

d. Survey of top corporate executives 

. A publisher offers college professors one of four best-selling 

mass-market books as an incentive for filling out a 10-page mail 

questionnaire about a new textbook. What advantages and dis- 
advantages does this incentive have? 

. “Individuals are less willing to cooperate with surveys today 

than they were 50 years ago.” Comment on this statement. 

. What do you think should be the maximum length of a self- 

administered e-mail questionnaire? 

. Do most surveys use a single communication mode (for exam- 

ple, the telephone), as most textbooks suggest? 

. A survey researcher reports that “205 usable questionnaires out 

of 942 questionnaires delivered in our mail survey converts to a 

21.7 percent response rate.” What are the subtle implications of 

this statement? 

. Evaluate the following survey designs: 

a. A researcher suggests mailing a small safe (a metal file box 
with a built-in lock) without the lock combination to 
respondents, with a note explaining that respondents will 
be called in a few days for a telephone interview. During 
the telephone interview, the respondent is given the com- 
bination and the safe may be opened. 

b. A shopping mall that wishes to evaluate its image places 
packets including a questionnaire, cover letter, and stamped 
return envelope in the mall where customers can pick them 
up if they wish. 

c. An e-mail message is sent to individuals who own comput- 
ers, asking them to complete a questionnaire on a Web 
site. Respondents answer the questions and then have the 
opportunity to play a slot-machine game on the Web site. 
Each respondent is guaranteed a monetary incentive but has 
the option to increase it by playing the slot-machine game. 

d. A mall intercept interviewing service is located in a 
regional shopping center. The facility contains a small room 
for television and movie presentations. Shoppers are used 
as sampling units. However, mall intercept interviewers 
recruit additional subjects for television commercial experi- 
ments by offering them several complimentary tickets for 
special sneak previews. Individuals contacted at the mall are 
allowed to bring up to five guests. In some cases the 
complimentary tickets are offered through ads in a local 
newspaper. 

e. Time magazine opts to conduct a mail survey rather than a 
telephone survey for a study to determine the demographic 
characteristics and purchasing behavior of its subscribers. 

. What type of research studies lend themselves to the use of 

e-mail for survey research? What are the advantages and disad- 

vantages of using e-mail? 

. ETHICS Comment on the ethics of the following situations: 

a. A researcher plans to use invisible ink to code question- 
naires to identify respondents in a distributor survey. 


10. 


11. 


12; 


f3; 


14. 


15; 


b. A political action committee conducts a survey about its 
cause. At the end of the questionnaire, it includes a request 
for a donation. 

c. A telephone interviewer calls at 1:00 p.m. on Sunday and 
asks the person who answers the phone to take part in an 
interview. 

d. An industrial manufacturing firm wishes to survey its 
own distributors. It invents the name “Mountain States 
Marketing Research” and sends out a mail questionnaire 
under this name. 

e. A questionnaire is printed on the back of a warranty card 
included inside the package of a food processor. The ques- 
tionnaire includes a number of questions about shopping 
behavior, demographics, and customer lifestyles. At the 
bottom of the warranty card is a short note in small print 
that says “Thank you for completing this questionnaire. 
Your answers will be used for further studies and to help 
us serve you better in the future. You will also benefit 
by receiving important mailings and special offers from a 
number of organizations whose products and services relate 
directly to the activities, interests, and hobbies in which 
you enjoy participating on a regular basis. Please indicate if 
there is some reason you would prefer not to receive this 
information.” 

ETHICS How might the business research industry take action 

to ensure that the public believes that telephone surveys and 

door-to-door interviews are legitimate activities and that firms 
that misrepresent and deceive the public using research as a sales 
ploy are not true researchers? 

Why is the mobile phone likely to be an ineffective way of 

reaching potential respondents in America? 

The American Testing Institute (also known as the U.S. 

Testing Authority) mails respondents what it calls a “television” 

survey. A questionnaire is sent to respondents, who are asked 

to complete it and mail it back along with a check for $14.80. 

In return for answering eight questions on viewing habits, the 

institute promises to send respondents one of twenty prizes 

ranging in value from $200 to $2,000—among which are video 
recorders, diamond watches, color televisions, and two nights 
of hotel accommodations at a land development resort commu- 
nity. The institute lists the odds of winning as 1 in 150,000 on 

all prizes except the hotel stay, for which the odds are 149,981 

out of 150,000. During a three-month period, the institute 

sends out 200,000 questionnaires. What are the ethical issues in 
this situation? 

‘NET Go to the Pew Internet and American Life page at http:// 

www.pewinternet.org. Several reports based on survey research 

will be listed. Select one of the reports. What were the research 
objectives? What were the first three questions on the survey? 

‘NET Go to the NPD Group Web site (http://www.npd.com) and 

click on the Store link. What types of custom and syndicated 

survey research services does the company offer? 

‘NET Go to the CASRO (Council of American Survey 

Research Organizations) home page (http://www.casro.org). 

Select “About Us.” What are the key aspects of this research 

organization’s mission? 
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Research Activities 


1. ‘NET Visit this Web site: http://www.zoomerang.com. What 
unique service does this company offer? Then visit this site: 
http://www.websurveyor.com. How does this service differ from 
Zoomerang? Create a short survey and e-mail it to 10 of your 
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friends without any advance notice. At the end of the survey, 
ask them if they would have responded had they not noticed 
the survey came from you. What is the response rate? What 
would it have been if the respondent did not know you? 


Case 10.1 National Do Not Call Registry 


Citizens’ annoyance with phone calls from sales- 
people prompted Congress to pass a law setting 


them to participate. But apparently respondents weren’t sure 
whether this practice was acceptable. Only one-fourth (24 percent) 


enthusiast’s life. Being able to cast and retrieve a lure and experi- 
ence the thrill of a big bass trying to take your rig away from you 
were among the joys of life that would be denied Barton’s father 
forever. 

Barton was determined to do something about it, if not 
for his father, then at least for others who had suffered a simi- 
lar fate. So, after tremendous personal expense and years of 
research and development, Barton perfected what is sure to be 
the standard bearer for all future freshwater electric reels. Forget 
those saltwater jobs, which Barton refers to as “winches.” He 
has developed something that is small, compact, and has incred- 
ible applications. 

He calls it the Royal Bee. The first word is obviously his first 
name. The second word refers to the low buzzing sound the reel 
makes when in use. 

The Royal Bee system looks simple enough and probably is 
if you understand the mechanical workings of a reel. A system of 
gears ties into the spool, and a motor in the back drives the gears 
attached to the triggering system. 


ae up a National Do Not Call Registry. The registry of respondents said they knew that researchers “are allowed to call,” 
20 was soon flooded with requests to have phone and over half (63 percent) weren’t sure about researchers’ rights 
ES numbers removed from telemarketers’ lists. By under the law. 
Se law, salespeople may not call numbers listed on 

this registry. The law makes exceptions for charities and researchers. Questions 

However, a recent poll suggests that even though phone calls from 1. Was an online survey the best medium for a poll on this sub- 

researchers may be legal, they are not always well received.” ject? What were some pros and cons of conducting this poll 

In late 2005, Harris Interactive conducted an Internet survey in online? 

which almost 2,000 adults answered questions about the National 2. How might the results have differed if this poll had been con- 

Do Not Call Registry. About three-quarters of the respondents said ducted by telephone? 

they had signed up for the registry, and a majority (61 percent) said 3. As a researcher, how would you address people’s doubts about 

they had since received “far less” contact from telemarketers. In whether pollsters may contact households listed on the Do Not 

addition, 70 percent said that since registering, they had been con- Call Registry? 

tacted by someone “who was doing a poll or survey” and wanted 

Case 10.2 Royal Bee Electric Fishing Reel 

"= Royal Barton started thinking about an electric All gearing of the electrical system can be disengaged so that 
- fishing reel when his father had a stroke and you can cast normally. But pushing the button for “retrieve” 

ne | fi lost the use of an arm. To see that happen to engages two gears. After the gears are engaged, the trigger travels far 
Zoi his dad, who had taught him the joys of fishing enough to touch the switch that tightens the drive belt, and there is 
z3 1 and hunting, made Barton realize what a chunk no slipping. You cannot hit the switch until the gears are properly 
Sz a physical handicap could take out of a sports engaged. This means that you cast manually, just as you would nor- 


mally fish, then you reengage the reel for the levelwind to work. 
And you can do all that with one hand! 

The system works on a 6-volt battery that you can attach to 
your belt or hang around your neck if you are wading. If you have 
a boat with a 6-volt battery, the reel can actually work off of the 
battery. There is a small connector that plugs into the reel, so you 
could easily use more than one reel with the battery. For instance, 
if you have two or three outfits equipped with different lures, you 
just switch the connector from reel to reel as you use it. A reel 
with the Royal Bee system can be used in a conventional manner. 
You do not have to use it as an electric reel unless you choose to 
do so. 

Barton believes the Royal Bee may not be just for handi- 
capped fishermen. Ken Cook, one of the leading professional 
anglers in the country, is sold on the Royal Bee. After he suffered 
a broken arm, he had to withdraw from some tournaments because 
fishing with one hand was difficult. By the time his arm healed, 
he was hooked on the Royal Bee because it increased bassing 
efficiency. As Cook explains, “The electric reel has increased my 
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efficiency in two ways. One is in flipping, where I use it all the 
time. The other is for fishing topwater, when I have to make a 
long cast. When I’m flipping, the electric reel gives me instant 
control over slack line. I can keep both hands on the rod. I never 
have to remove them to take up slack. I flip, engage the reel, and 
then all I have to do is push the lever with my thumb to take up 
slack instantly.” 

Cook’s reel (a Ryobi 4000) is one of several that can be con- 
verted to the electric retrieve. For flipping, Cook loads his reel with 
20-pound test line. He uses a similar reel with lighter line when 
fishing a surface lure. “What you can do with the electric reel is 
eliminate unproductive reeling time,” Cook says. 

A few extra seconds may not mean much if you are out on a 
neighborhood pond just fishing on the weekend. But it can mean 
a lot if you are in tournament competition, where one extra cast 
might keep you from going home with $50,000 tucked in your 
pocket. “Look at it this way,” Cook explains. “Let’s suppose we’re 
in clear water and it’s necessary to make a long cast to the cover we 
want to fish with a topwater lure. There’s a whole lot of unproduc- 
tive water between us and the cover. With the electric reel, I make 


237 


my long cast and fish the cover. Then, when I’m ready to reel in, 
I just press the retrieve lever so the battery engages the necessary 
gears, and I’ve got my lure back ready to make another cast while 
youre still cranking.” 

When Royal Barton retired from his veterinary supply busi- 
ness, he began enjoying his favorite pastimes: hunting, fishing, and 
developing the Royal Bee system. He realized he needed help in 
marketing his product, so he sought professional assistance to 
learn how to reach the broadest possible market for the Royal 
Bee system. 


Questions 

1. What business research problem does Royal Barton face? What 
are his information needs? Outline some survey research objec- 
tives for a research project on the Royal Bee system. 

2. What type of survey—personal interview, telephone interview, 
or mail survey—should be selected? 

3. What sources of survey error are most likely to occur in a study 
of this type? 

4. What means should be used to obtain a high response rate? 


CHAPTER 11 
OBSERVATION 


METHODS 


After studying this chapter, you should be able to 
Discuss the role of observation as a business research 


ile 
method 
2. Describe the use of direct observation and contrived 


observation 
3. Identify ethical issues in observation studies 
4. Explain the observation of physical objects and message 


content 
5. Describe major types of mechanical observation 


6. Summarize techniques for measuring physiological 


reactions 


Chapter Vignette: Mystery Diner 
at Seasons Restaurant 


Mike and Marilyn, Brian and Mary Kay, and Mitch and Jill were certainly enjoying their dinner at 
Seasons Restaurant on the seventh floor of the Four Seasons Hotel in Chicago. The restaurant 


is “an extravagant affair” with mahogany paneled walls, beautiful brocade armchairs, and fresh 
flowers everywhere. They had started by splitting a bottle of champagne 


before each ordering the eight-course degustation—eight separate 
dishes, each with a matching wine. The three couples were enjoying 

the service, the food, the wine, and the company of their friends, a bit 
unaware of the other diners. However, they were being closely observed 
without even realizing it. A mystery shopper (or mystery diner in this case) 
was sitting near them, observing their dining experience, as well as the 


service being provided. 
Mystery shoppers (or mystery diners or mystery employees) can help 


inspect and evaluate a variety of activities, including customer service, 
company operations, employee integrity, store merchandising, and prod- 
uct quality. Mystery shopping originated as a technique used by private 
investigators to identify and prevent employee theft—primarily at banks 
and retail stores. By posing as workers, mystery employees could become 
part of the organization and observe the operation and employee behav- 
ior, including identifying opportunities for theft and workers that might 
be stealing. The term “Mystery Shopping” was coined in the 1940s by 
WilMark, the first research firm to apply the concept beyond integrity appli- 
cations. Since then, we have seen widespread application of mystery shop- 


ping. Today, over 100 companies belong to the Mystery Shopping Providers 
Association (MSPA) and the industry is estimated to be over $1.5 billion 


annually. 

Mystery shoppers can prove advantageous in many ways. A mystery shop- 
per allows an organization to view their operation through a trained customer's 
(or employee's) eyes. Questioning employees is certainly unlikely to reveal 
employee theft. Similarly, a survey of the wait staff at Seasons Restaurant would 

probably indicate that they are attentive to diners, keep the water glasses filled, 
and are consistently polite. Observing these behaviors, however, can provide a far more accu- 
rate picture and more detailed information. Mystery shoppers can report how long they waited, 
how they were treated, and even note that some diners are “not the typical Seasons crowd.”' 
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Introduction 


Mystery shoppers are just one observational approach to collecting research data. While survey 
data can provide some insight into future or past behavior, one can hardly argue with the power 
of data representing actual behavior. This chapter introduces the various techniques involved in 
observational methods of data gathering in business research. 


Observation in Business Research 


In business research, observation is a systematic process of recording behavioral patterns of peo- 
ple, objects, and occurrences as they happen. No questioning or communicating with people is 
needed. Researchers who use observation as a method of data collection either witness and record 
information while watching events take place or take advantage of some tracking system such as 
check-out scanners or Internet activity records. These tracking systems can observe and provide 
data such as whether or not a specific consumer purchased more products on discount or at regular 
price or how long an employee takes to complete a specific task. 
Observation becomes a tool for scientific inquiry when it meets several conditions: 


e The observation serves a formulated research purpose. 

e The observation is planned systematically. 

e The observation is recorded systematically and related to general propositions, rather than 
simply reflecting a set of interesting curiosities. 

¢ The observation is subjected to checks or controls on validity and reliability.’ 


What Can Be Observed? 


Observational studies gather a wide variety of information about behavior. Exhibit 11.1 lists seven 
kinds of observable phenomena: physical actions, such as shopping patterns (in-store or via a Web 
interface) or television viewing; verbal behavior, such as sales conversations or the exchange between 
a worker and supervisor; expressive behavior, such as tone of voice, facial expressions, or a coach 
stomping his foot; spatial relations and locations, such as traffic patterns; temporal patterns, such as 
amount of time spent shopping, driving, or making a business decision; physical objects, such as the 
amount of newspapers recycled or number of beer cans in the trash; and verbal and pictorial records, 
such as the content of advertisements or the number of minorities pictured in a company brochure. 
(Investigation of secondary data also uses observation, but that subject was described in Chapter 8 
and is not extensively discussed in this chapter.) 


Phenomenon Example 


Physical action A worker's movement during an assembly process 

Verbal behavior Statements made by airline travelers while waiting in line 
Expressive behavior Facial expressions, tones of voices, and forms of body language 
Spatial relations and locations Proximity of middle managers’ offices to the president's office 
Temporal patterns Length of time it takes to execute a stock purchase order 
Physical objects Percent of recycled materials compared to trash 


Verbal and pictorial records Number of illustrations appearing in a training booklet 
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observation 


The systematic process of record- 
ing the behavioral patterns of 
people, objects, and occurrences 
as they are witnessed. 


—Louis Pasteur 


What Can Be Observed 


Observation can be a very useful form of data collection. and identify the strengths and weaknesses of 


After reading this chapter you should be able to understand observation relative to other forms of data 


COURTESY OF QUALTRICS.COM 


SSS eee 


collection. 

Considering these strengths 
and weaknesses, review the 
online survey. Are there areas 
where you feel observation would be a better 
method of gathering information than what 
the online survey will provide? Identify at least 
one area or issue that you believe could either 
be better addressed by observation than a 
survey, or where observation could be used 
to enhance the information provided by the 
survey. Design and describe an observation 
approach to provide this information. 


EPEE OANE E RTE mA Hae AREAS RAPER — 


Somewhat 
Unlikely 


Very Likely Likely Somewhat Likely Undecided Unlikely Very Unlikely 


visible observation 


Observation in which the 


observer's presence is known to 


the subject. 


hidden observation 


Observation in which the subject 
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is unaware that observation is 
taking place. 


While the observation method may be used to describe a wide variety of behavior, cogni- 
tive phenomena such as attitudes, motivations, and preferences cannot be observed. As a result, 
observation research cannot provide an explanation of why a behavior occurred or what actions 
were intended. Another limitation is that the observation period generally is short. Observing 
behavior patterns that occur over a period of several days or weeks generally is too costly or even 
impossible. Nonetheless, observation can provide some very interesting insights as described in the 
Research Snapshot on the next page. 


The Nature of Observation Studies 


Business researchers can observe people, objects, events, or other phenomena using either human 
observers or machines designed for specific observation tasks. Human observation best suits a situ- 
ation or behavior that is not easily predictable in advance of the research. Mechanical observation, 
as performed by supermarket scanners or traffic counters, can very accurately record situations or 
types of behavior that are routine, repetitive, or programmatic. 

Human or mechanical observation is generally unobtrusive, meaning no communication 
with a respondent takes place. For example, rather than asking an employee how long it 
takes to handle an insurance claim, a researcher might observe and record the time it takes 
for different steps in this process. Or, rather than ask a consumer how long they spend 
shopping for produce, a researcher can watch shoppers in a supermarket and note the 
time each spends in the produce area. As noted in the opening vignette, the unobtrusive 
or nonreactive nature of the observation method often generates data without a subject’s 
knowledge. A situation in which an observer’s presence is known to the subject involves 
visible observation. A situation in which a subject is unaware that observation is taking place 
is hidden observation. Hidden, unobtrusive observation minimizes respondent error. Asking 
subjects to participate in the research is not required when they are unaware that they are 
being observed. 
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/ This Trend Brought to You 
~ by DDB SignBank 
Extending the practice of observation 

beyond what can clearly be done scientifically, 
such as counting the number of tomato soup cans 
in a pantry or measuring the time spent watching television, 
some researchers have tried to catalog behaviors that may signal 
the beginning of important trends. This practice, called trend 
spotting, is controversial because the observations are subjective 
and unsystematic. In spite of the criticism, marketers are increas- 
ingly turning to trend spotters, so researchers have an incentive 
to develop this method's capabilities. 

Starting in its office in Copenhagen, Denmark, giant ad 
agency DDB Worldwide has created a service called DDB 
SignBank, which invites all of DDB’s staff throughout the 
world, plus other targeted groups such as members of youth 
organizations, to submit their observations to managers 
appointed as SignBankers. Staff members are directed to iden- 
tify consumer behaviors, rather than comments gathered from 
other research methods, that might signal a new trend in the 
society or culture. The SignBankers classify the observations 
and enter them into a corporate database. The database is 
updated each day, and account teams at the agency 
can search it for signs related to their clients’ advertising 
objectives. 

The idea behind SignBank, developed by sociologist Eva 
Steensig, is that the size of the database (which contained 
thirty thousand signs at a recent count) will allow patterns to 


emerge in the sheer number of observations. The data may be 
most useful as a source of ideas to test more rigorously. Anthon 
Berg, a Scandinavian brand of chocolate, used SignBank data 
to identify new occasions for which to promote chocolate and 
new uses for chocolate in health and beauty treatments. 

Recently, SignBank has observed a shift in consumers from 
“herds” to “swarms.” Herds are a single body of people that share 
a common view and choose a joint direction led by an opinion 
leader. Swarms are a group of individuals with differing opinions 
that go in a multitude of directions. DDB claims that the informa- 
tion available on the Internet has empowered consumers and 
they don't “believe just anything anymore.” As a result, tradi- 
tional institutions and media sources, such as churches, banks, 
newspapers, and brands, are losing power. Individuals are shar- 
ing information directly and being strengthened by becoming a 
member of the swarm. 


Sources: Based on Creamer, Matthew, “DDB Collects ‘Signs’ to Identify Trends,” 
Advertising Age (December 5, 2005), downloaded from http://www.adage.com, 
accessed June 16, 2006; Pfanner, 

Eric, “On Advertising: Do | Spot a 
Trend?” International Herald Tribune 
(January 1, 2006), www.iht.com; 

DDB Worldwide, “DDB Worldwide 
Introduces DDB SignBank, a New 
Consumer Knowledge Model,” news 
release (November 29, 2005), http:// 
www.ddbneedham.dk; “From Herds to 
Swarms,” Marketing Tribune 7 (April 7, 
2008), 30-31, accessed at http://www. 
ddbamsterdam.nl/public/en/sign- 
bank/signbank. 
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The major advantage of observation studies over surveys, which obtain self-reported data from 
respondents, is that the data are free from distortions, inaccuracies, or other response biases due to 
memory error, social desirability bias, and so on. The data are recorded when the actual behavior 
takes place. 


Observation of Human Behavior 


Whereas surveys emphasize verbal responses, observation studies emphasize and allow for the sys- 
tematic recording of nonverbal behavior. Toy manufacturers such as Fisher Price use the observation 
technique because children often cannot express their reactions to products. By observing children at 
play with a proposed toy, doll, or game, business researchers may be able to identify the elements of a 
potentially successful product. Toy researchers might observe play to answer the following questions: 


e How long does the child’s attention stay with the product? 
e How exactly does the child play with the toy? 
e Are the child’s peers equally interested in the toy? 


Behavioral scientists have recognized that nonverbal behavior can be a communication process by 
which meanings are exchanged among individuals. Head nods, smiles, raised eyebrows, and other 
facial expressions or body movements have been recognized as communication symbols. Obser- 
vation of nonverbal communication may hold considerable promise for the business researcher. 
For example, a hypothesis about customer-salesperson interactions is that the salesperson would 
signal status based on the importance of each transaction. In low-importance transactions, in 
which potential customers are plentiful and easily replaced (say, a shoe store), the salesperson may 
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Part 3: Research Methods for Collecting Primary Data 


show definite nonverbal signs of higher status than the customer. When customers are scarce, as 
in big-ticket purchase situations, the opposite should be true. For example, real estate sales agents 
may display nonverbal indicators of deference. One way to test this hypothesis would be with an 
observation study using the nonverbal communication measures shown in Exhibit 11.2. 


BIT 11.2 Observing and Interpreting Nonverbal Communication 


Behavior 


Facial expressions 


Body language 


Eye activity 


Personal space 


Gestures 


Manners 


direct observation 


A straightforward attempt to 
observe and record what natu- 
rally occurs; the investigator does 
not create an artificial situation. 


D 


Description 


Expressions of emotion such as surprise (eyes 
wide open, mouth rounded and slightly open, 
brow furrowed) 


Posture, placement of arms and legs 


Eye contact, staring, looking away, dilated 


pupils. In U.S. culture, not making eye contact is 
indicative of a deteriorating relationship. Dilated 


pupils can indicate emotion or degree of honesty. 


Physical distance between individuals; in the 
United States, people like to be about eight feet 
apart to have a discussion. 


Responses to certain events with specific body 
reactions or gestures 


Example 


A consumer reacts to the price quoted by a 
salesperson. 


A consumer crosses arms as salesperson speaks, 
possibly indicating a lack of trust. 


A consumer avoids making eye contact with 
a salesperson knowing that he or she will not 
make a purchase. 


A consumer may back away from a salesperson 
who is viewed to be violating one’s personal 
space. 


A consumer who wins something (maybe at the 
casino or a sports contest) lifts arms, stands tall, 


y J Accepted protocol for given situations 


and sticks out chest. 


A salesperson may shake a customer's hand, but 
should not touch a customer otherwise. 


Of course, researchers would not ignore verbal behavior. In fact, in certain observation stud- 
ies, verbal expression is very important. 


Complementary Evidence 


The results of observation studies may extend the results of other forms of research by provid- 
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ing complementary evidence concerning individuals’ “true” feelings. Focus group interviews often 
are conducted behind two-way mirrors from which executives observe as well as listen to what 
is occurring. This additional source allows for interpretation of nonverbal behavior such as facial 
expressions or head nods to supplement information from interviews. 

For example, in one focus group session concerning women’s use of hand lotion, research- 
ers observed that all the women’s hands were above the table while they were casually waiting 
for the session to begin. Seconds after the women were told that the topic was to be hand lotion, 
all their hands were placed out of sight. This observation, combined with the group discussion, 
revealed the women’s anger, guilt, and shame about the condition of their hands. Although 
they felt they were expected to have soft, pretty hands, their housework required them to wash 
dishes, clean floors, and do other chores that were hard on their hands. Note, however, that 
without the discussion provided by the participants the researcher would only have been able 
to note the action of placing their hands under the table, not the explanation for this behavior. 


Direct Observation 


Direct observation can produce detailed records of what people actually do during an event. The 
observer plays a passive role, making no attempt to control or manipulate a situation, instead 
merely recording what occurs. Many types of data can be obtained more accurately through direct 
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observation than by questioning. For example, recording traffic counts or observing the direc- 
tion of customer movement within a supermarket can help managers design store layouts that 
maximize the exposure of departments that sell impulse goods. A manufacturer can determine 
the number of facings, shelf locations, display maintenance, and other characteristics that improve 
store conditions. If directly questioned in a survey, most shoppers would be unable to accurately 
portray the time they spent in each department. The observation method, in contrast, could deter- 
mine this without difficulty. 

With the direct observation method, the data consist of records of events made as they occur. 
An observation form often helps keep researchers’ observations consistent and ensures that they 
record all relevant information. A respondent is not required to recall—perhaps inaccurately—an 
event after it has occurred; instead, the observation is instantaneous. 

In many cases, direct observation is the most straightforward form of data collection—or the 
only form possible. A produce manager for Auchan (a France-based hypermart firm) may peri- 
odically gather competitive price information from Carrefour (also a France-based hypermart 
firm) stores within competing areas. Both Carrefour and Auchan can monitor each other’s pro- 
motions by observing promotions posted on the competitor’s Web site (see http://www.auchan.fr 
and http://www.carrefour.fr, for example). In other situations, observation is the most economical 
technique. In a common type of observation study, a shopping center manager may observe the 
license plate (tag) numbers on cars in its parking lot. These data, along with automobile registra- 
tion information, provide an inexpensive means of determining where customers live. 

Certain data may be obtained more quickly or easily using direct observation than by other 
methods—gender, race, and other respondent characteristics can simply be observed. Researchers 
investigating a diet product may use observation when selecting respondents in a shopping mall. 
Overweight people may be prescreened by observing pedestrians, thus eliminating a number 
of screening interviews. Behaviors occurring in public places can also be easily observed, as the 
Research Snapshot on the next page shows. 

In a quality-of-life survey, researchers asked respondents a series of questions that were 
compiled into an index of well-being. But interviewers also used direct observation because 
the researchers wanted to investigate the effect of weather conditions on people’s answers. The 
researchers quickly and easily observed and recorded outside weather conditions on the day of the 
interviews, as well as the temperature and humidity in the building in which the interviews were 
conducted.? 

Recording the decision time necessary to make a choice between two alternatives is a rela- 
tively simple, unobtrusive task easily accomplished through direct observation. Observing the 
choice time as a measure of the strength of the preference between alternatives is called response 
latency. This measure is based on the hypothesis that the longer a decision maker takes to choose 
between two alternatives, the closer the two alternatives are in terms of preference. In con- 
trast, making a quick decision presumably indicates a considerable psychological distance between 
alternatives—that is, the choice is obvious. It is simple for a computer to record decision times, 
so the response latency measure has gained popularity now that computer-assisted data collection 
methods are common. 


ERRORS ASSOCIATED WITH DIRECT OBSERVATION 


Although direct observation involves no interaction with the subject, the method is not error-free; 
the observer may record events subjectively. The same visual cues that may influence the interplay 
between interviewer and respondent (e.g., the subject’s age or sex) may come into play in some 
direct observation settings, such as when the observer subjectively attributes a particular economic 
status or educational background to a subject. A distortion of measurement resulting from the 
cognitive behavior or actions of the witnessing observer is called observer bias. For example, in 
a research project using observers to evaluate whether sales clerks are rude or courteous, field- 
workers may be required to rely on their own interpretations of people or situations during the 
observation process. 

Also, accuracy may suffer if the observer does not record every detail that describes the per- 
sons, objects, and events in a given situation. Generally, the observer should record as much detail 
as possible. However, the pace of events, the observer’s memory and writing speed, and other 
factors will limit the amount of detail that can be recorded. 
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response latency 


The amount of time it takes to 
make a choice between two 
alternatives; used as a measure of 
the strength of preference. 


observer bias 


A distortion of measurement 
resulting from the cognitive 
behavior or actions of a witness- 
ing observer. 
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Clean as We Say, or Clean as We Do? 

People know that hand washing is a fundamental way to stay 
healthy, not to mention simple good manners. So, when you 
ask them, most people say they faithfully wash their hands. But 
according to observational research, what people say about this 
behavior is not what they necessarily do. 

The American Society for Microbiology and the Soap and 
Detergent Association together arranged for a nationwide 
study of hand washing by U.S. adults. In an online survey by 
Harris Interactive, 91 percent of adults said they always wash 
their hands after using a public restroom. Men were somewhat 
less likely to make this claim—88 percent, versus 94 percent 
of women. The researchers followed up on the survey results 
by observing adults in public restrooms in Atlanta, Chicago, 
New York City, and San Francisco. A 2007 tally of the percent- 
age who washed their hands found that only 77 percent did so. 
About 66 percent of men were observed washing their hands 
after going to the restroom while women washed their hands 
88 percent of the time. The difference between reporting of 
hand washing and actual hand washing was greater for the 
men (about a 22 percent dif- 


cleanest hands as 81 percent of people can E 
be observed washing after a toilet break 

while San Francisco scored lowest at 73 per- 4 
cent overall. Additionally, handwashing is 
down 6 percent since 2005. 

This research showing a divide between 
what individuals believe they should be doing, what they say 
they do, and what they actually do could be useful in helping 
agencies craft messages aimed at improving citizens’ health. In 
addition, soap marketers may want to learn more about what 
keeps individuals from washing their hands (is it inconvenient? 
are public sinks a turnoff?), even while being prepared for some 
response bias. 

The study was conducted by having observers discreetly watch 
and record the frequency of the number of people using a public 
toilet facility and the number of people who washed their hands. 
Observers pretended to be grooming themselves while watching 
the visitors. Over 6,000 people were observed in four U.S. cities. Do 
you think a hidden camera would reveal different results? 


Source: Based on “Hygiene Habits Stall: Public Handwashing Down,” Cleaning 101, 


—Sir John Lubbock 


contrived observation 


Observation in which the 
investigator creates an artificial 
environment in order to test a 

hypothesis. 
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www.cleaning101.com/newsroom/09-17-07.cfm; Harris Interactive, “Many Adults 
Report Not Washing Their Hands When They Should, and More People Claim to 
Wash Their Hands than Who Actually Do,” news release (December 14, 2005); “Hand 
Washing Survey Fact Sheet” (2005), http://www.cleaning101.com, accessed February 
24, 2006; and Harris Interactive, “A Survey of Hand Washing Behavior (2005 Find- 
ings)” (September 2005), accessed at “2005 ASM/SDA Hand Hygiene Survey Results,” 
http://www.cleaning101.com (SDA Web site), February 24, 2006. 


ference) than for the women 
(6 percent). The numbers also 
vary geographically across 
the United States. Among 
major cities, Chicago has the 


Interpretation of observation data is another potential source of error. Facial expressions and 
other nonverbal communication may have several meanings. Does a smile always mean happiness? 
Does the fact that someone is standing or seated next to the president of a company necessarily 
indicate the person’s status? 


SCIENTIFICALLY CONTRIVED OBSERVATION 


Most observation takes place in a natural setting, but sometimes the investigator intervenes to 
create an artificial environment in order to test a hypothesis. This approach is called contrived 
observation. Contrived observation can increase the frequency of occurrence of certain behavior 
patterns, such as employee responses to complaints. An airline passenger complaining about a meal 
or service from the flight attendant may actually be a researcher recording that person’s reactions. 
If situations were not contrived, the research time spent waiting and observing would expand 
considerably. This is one of the reasons for the growing popularity of mystery shoppers introduced 
in the opening vignette. They can effectively create a situation (such as a customer complaint) that 
might be very time consuming to observe if it were to occur naturally. 


Combining Direct Observation and Interviewing 


Some research studies combine visible observation with personal interviews. During or after 
detailed observations, individuals are asked to explain their actions.* For example, direct obser- 
vation of women applying hand and body lotion identified two kinds of users. Some women 
slapped on the lotion, rubbing it briskly into their skin. Others caressed their skin as they applied 
the lotion. When the women were questioned about their behavior, the researchers discovered 
that women who slapped the lotion on were using the lotion as a remedy for dry skin. Those who 
caressed their skin were more interested in making their skin smell nice and feel soft. 
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Ethical Issues in the 
Observation of Humans 


Observation methods introduce a number of ethical issues. Hid- 
den observation raises the issue of the respondent’s right to privacy. 
Suppose a research firm is approached by a company interested in 
acquiring information about how women put on their bras. The 
researcher considers approaching spas in several key cities about 
placing small cameras inconspicuously to observe women getting 
dressed. Obviously, this is an illegal and unethical approach. How- 
ever, what if other women are hired to observe and record this 
activity? While to some extent the dressing room is an area where 
women often do dress where others can observe them, women do 
not expect to have their dressing behavior recorded. Therefore, 
unless a way can be found to have some women consent to such 
observation, this observational approach is unethical. 

Some people might see contrived observation as entrap- 
ment. To entrap means to deceive or trick into difficulty, which 
clearly is an abusive action. The problem is one of balancing 
values. If the researcher obtains permission to observe someone, 
the subject may not act naturally. So, at times there is a strong 
temptation to observe without obtaining consent. In other times, 
such as monitoring mall traffic, obtaining consent just to observe 
people walking through the mall would be difficult. 

So, when should researchers feel comfortable collecting 
observational data? While exceptions exist to every rule, here 
are three questions that can help address this question: 


1. Is the behavior being observed commonly performed in 
public where it is expected that others can observe the 
behavior? 

2. Is the behavior performed in a setting in which the anonymity—meaning there is no way to 
identify individuals—of the person being observed is assured? 

3. Has the person agreed to be observed? 


If the answers to the first two questions are yes, then there is not likely a violation of privacy in 
collecting observational research data. If the answer to the third question is yes, then gathering the 
data also is likely to be ethical. 


Observation of Physical Objects 


Physical phenomena may be the subject of observation study. Physical-trace evidence is a visible 
mark of some past event or occurrence. For example, the wear on library books indirectly indicates 
which books are actually read (handled most) when checked out. A classic example of physical-trace 
evidence in a nonprofit setting was erosion on the floor tiles around the hatching-chick exhibit at 
Chicago’s Museum of Science and Industry. These tiles had to be replaced every six weeks; tiles 
in other parts of the museum did not need to be replaced for years. The selective erosion of tiles, 
indexed by the replacement rate, was a measure of the relative popularity of exhibits. 

Clearly, a creative business researcher has many options for determining the solution to a prob- 
lem. The story about Charles Coolidge Parlin, generally recognized as one of the founders of 
commercial business research, counting garbage cans at the turn of the twentieth century illustrates 
another study of physical traces. 

Parlin designed an observation study to persuade Campbell’s Soup Company to advertise in 
the Saturday Evening Post. Campbell’s was reluctant to advertise because it believed that the Post 
was read primarily by working people who would prefer to make soup from scratch, peeling 
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Even if fashion companies 
could learn a lot about the 
types of problems consumers 
typically have when purchasing 
and wearing clothes, would 
observation through two-way 
mirrors be appropriate? 


What would you 
rather believe? What I 
say, or what you saw 
with your own eyes? 


—Groucho Marx 
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Picking through the garbage 
on the side of the road can 
reveal behaviors of fast-food 
customers. 


content analysis 


The systematic observation and 
quantitative description of 

the manifest content of 
communication. 
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the potatoes and scraping the car- 
rots, rather than paying ten cents 
for a can of soup. To demonstrate 
that rich people weren’t the target 
market, Parlin selected a sample of 
Philadelphia garbage routes. Gar- 
bage from each specific area of the 
city that was selected was dumped 
on the floor of a local National 
Guard Armory. Parlin had the 
number of Campbell’s soup cans 
in each pile counted. The results 
indicated that the garbage from 
the rich people’s homes didn’t 
contain many cans of Campbell’s 
soup. Although they may not 
have made soup from scratch 
themselves, their housekeepers 
may have. The garbage piles from 
the blue-collar area showed a 
larger number of Campbell’s soup 
cans. This observation study was enough evidence for Campbell’s. They advertised in the Saturday 
Evening Post.’ 

The method used in this study has since been used in a scientific project at the University 
of Arizona in which aspiring archaeologists have sifted through garbage for over 30 years. They 
examine soggy cigarette butts, empty milk cartons, and half-eaten Big Macs in an effort to under- 
stand modern life. 

What is most interesting about the garbage project is that observations can be compared with 
the results of surveys about food consumption—and garbage does not lie. This type of observation 
can correct for overreporting consumption of healthful items and underreporting of, say, cigarette 
or alcohol consumption. 

Another application of observing physical objects is to count and record physical invento- 
ries through retail or wholesale audits. This method allows researchers to investigate brand sales 
on regional and national levels, market shares, seasonal purchasing patterns, and so on. Business 
research suppliers offer audit data at both the retail and the wholesale levels. 

An observer can record physical-trace data to discover information a respondent could not 
recall accurately. For example, measuring the number of ounces of a liquid bleach used during a 
test provides precise physical-trace evidence without relying on the respondent’s memory. The 
accuracy of respondents’ memories is not a problem for the firm that conducts a pantry audit. The 
pantry audit requires an inventory of the brands, quantities, and package sizes in a consumer’s 
home rather than responses from individuals. The problem of untruthfulness or some other form 
of response bias is avoided. For example, the pantry audit prevents the possible problem of respon- 
dents erroneously claiming to have purchased prestige brands. However, gaining permission to 
physically check consumers’ pantries is not easy, and the fieldwork is expensive. In addition, the 
brand in the pantry may not reflect the brand purchased most often if consumers substituted it 
because they had a coupon, the usual brand was out of stock, or some other reason. 


Content Analysis 


Besides observing people and physical objects, researchers may use content analysis, which obtains 
data by observing and analyzing the contents or messages of advertisements, newspaper articles, 
television programs, letters, and the like. This method involves systematic analysis as well as 
observation to identify the specific information content and other characteristics of the messages. 
Content analysis studies the message itself and involves the design of a systematic observation 
and recording procedure for quantitative description of the manifest content of communication. 
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This technique measures the extent of emphasis or omission of a given analytical category. For 
example, content analysis of advertisements might evaluate their use of words, themes, characters, 
or space and time relationships. Another topic of content analysis is the frequency with which 
women, African-Americans, or ethnic minorities appear in mass media. 

Content analysis might be used to investigate questions such as whether some advertisers 
use certain themes, appeals, claims, or deceptive practices more than others or whether recent 
consumer-oriented actions by the Federal Trade Commission have influenced the contents of 
advertising. A cable television programmer might do a content analysis of network programming 
to evaluate its competition. Every year researchers analyze the Super Bowl telecast to see how 
much of the visual material is live-action play and how much is replay, or how many shots focus 
on the cheerleaders and how many on spectators. Content analysis also can explore the informa- 
tion content of television commercials directed at children, the company images portrayed in ads, 
and numerous other aspects of advertising. 

Study of the content of communications is more sophisticated than simply counting the items; 
it requires a system of analysis to secure relevant data. After one employee role-playing session 
involving leaders and subordinates, researchers analyzed videotapes to identify categories of verbal 
behaviors (e.g., positive reward statements, positive comparison statements, and self-evaluation 
requests). Trained coders, using a set of specific instructions, then recorded and coded the leaders’ 
behavior into specific verbal categories. 


Mechanical Observation 


In many situations, the primary—and sometimes the only—means of observation is mechanical 
rather than human. Video cameras, traffic counters, and other machines help observe and record 
behavior. Some unusual observation studies have used motion-picture cameras and time-lapse 
photography. An early application of this observation technique photographed train passengers 
and determined their levels of comfort by observing how they sat and moved in their seats. 
Another time-lapse study filmed traffic flows in an urban square and resulted in a redesign of the 
streets. Similar techniques may help managers determine how to better organize and arrange items 
in a warehouse or improve the design of store layouts to enhance traffic flow. Mechanical devices 
can also be utilized to observe employees and their actions when they can not be observed in 
person as illustrated in the Research Snapshot on the next page. 


Television Monitoring 


Perhaps the best-known research project involving mechanical observation and computerized data 
collection is ACNielsen’s television monitoring system for estimating national television audiences. 
Nielsen Media Research uses a consumer panel and a monitoring device called a PeopleMeter to 
obtain ratings for television programs nationwide.° The Nielsen PeopleMeter gathers data on what 
each television in a household is playing and who is watching it at the time. Researchers attach 
electronic boxes to television sets and remote controls to capture 
information on program choices and the length of viewing time. 
Nielsen matches the signals captured through these devices with 
its database of network broadcast and cable program schedules so 
that it can identify the specific programs being viewed. 

When a television in the panel household is turned on, a red 
light on the PeopleMeter periodically flashes to remind viewers to 
indicate who is watching. The viewer then uses a remote control 
to record who is watching. One button on the control is assigned 
to each member of the household and a separate visitor button 
is used for potential guests. The household member presses his 
or her button to indicate the sex and age of the person who is 


watching. Knowing who in the family is watching allows execu- vided ‘joo oO yee 


ptk? 


tives to match television programs with demographic profiles. aM O yo a Soo 
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television monitoring 


Computerized mechanical obser- 
vation used to obtain television 
ratings. 


Believe it or not, this company 
can “observe” what radio 


station you are listening to. 
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NeoTech’s Mobile-Trak Observes Fleet Vehicles 


First incorporated in 1996, NeoTech has developed sophisticated 
monitoring and tracking devices for fleet vehicles. While manag- 
ers cannot directly observe their driver's actions, the Mobile-Trak II 
modular vehicle tracking system provides detailed information 
about what is happening on the road. This electronic device can 
pinpoint the location of any equipped vehicle through its Global 
Positioning System (GPS), as well as record detailed trip informa- 
tion, including start and end times, distance traveled, average 
and top speed, idle time, off-hour usage, and the operator's driv- 


ing habits. 


NeoTech’s Mobile-Trak II provides managers with the answers 


to important questions: 


e Do my drivers 
report more 


j Mobile-Trak Il 


Locate your vil at any time and anywhere 
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hours than they 

. should? 

¥| e Do my drivers 
stop too long at 
their stops? 

e Are my drivers 
speeding? 


Traffic cameras that monitor 
speeding on major highways 
are becoming commonplace in 
Europe, Australia, and even in 


some parts of the United States. 


Would car companies learn 
anything from the observed 
behavior? 


248 


off-hour periods? 


e Are we getting accurate mileage 


readings? 


Do my drivers wear their seat belts? 
e Are my drivers using our vehicles during 


e Have fault codes/malfunction indicators 


gone unreported? 


Not only is this observation technique useful to manage driv- 
ers, but it can assist fleet managers with many of their responsi- 
bilities. The service requirements for the vehicle can be carefully 
monitored, dispatchers know which driver is closest to the next 
service call, and the company can easily download data for route 
analysis, mileage reports, fuel tax reports, and state line crossings 
for tax purposes. The Mobile-Trak II even monitors g-loads so 
managers can be sure the vehicle is not operated in a dangerous 
manner or in a way that could damage delicate cargo. 

An important issue for any manager is monitoring employees 
who are out in the field. The Mobile-Trak II is like having a man- 


ager riding with every driver. 


Source: Based on NeoTech, Inc. PowerPoint presentation at http://www.neotech 
.com/view_presentation.htm, accessed February 22, 2009. 


Each night, Nielsen’s computers automatically retrieve the data stored in the PeopleMeter’s 


recording box. In this way, Nielsen gathers daily estimates of when televisions are in use, which 


channels are used, and who is viewing each program. The panel includes more than five thousand 


households, selected to be representative of the U.S. population. For local programming, Nielsen 


uses additional panels equipped with recording devices but not PeopleMeters to record viewer 


demographics. (Nielsen uses surveys to record demographic data for local programming.) 


Critics of the PeopleMeter argue that subjects in Nielsen’s panel grow bored over time and 


do not always record when they begin or stop watching television. Arbitron, best known 


for 
measuring radio audiences, has 
attempted to answer this objec- 
tion with its own measuring sys- 
tem, which it calls the Portable 
People Meter.’ The Portable 
People Meter, which occupies 
about 4 cubic inches and weighs 
less than 3 ounces, reads inaudible 
codes embedded in audio signals 
to identify their source. Study 
participants wear or carry the 
meter throughout the day, and 
it automatically picks up codes 
embedded in whatever radio and 
television signals they encounter. 
At the end of the day, the partici- 
pant inserts the meter into a “base 
which extracts the data 
collected, sends it to a household 
hub, and recharges the battery. 


J 


station,’ 
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The household hub then sends the data to Arbitron’s computer over phone lines. To encourage 
cooperation, the meter has a motion sensor connected to a green light signaling that the meter 
senses it is being carried. Each participant is awarded points for the amount of time the meter is on. 
Total points are displayed in the base station and used to determine the size of the incentive paid 
to each participant. Arbitron’s meter simplifies the participants’ role and collects data on exposure 
to radio and television programming outside the home. However, the device records only signals 
that the radio or television system embeds using Arbitron’s equipment. 

Other devices gather data about the viewing of advertisements. The TiVo digital televi- 
sion recorder, collects detailed viewing data, such as what commercials people skip by using 
fast-forward. The PreTesting Company sets up contrived observational studies in which viewers 
equipped with a remote control are invited to watch any of three prerecorded channels playing 
different programs and advertisements, including the client’s ads to be tested.* The system records 
the precise points at which the viewer changes the channel. By combining the results from many 
participants, the company arrives at a Cumulative Zapping Score, that is, the percentage of view- 
ers who had exited the client’s advertisement by each point in the ad. So that viewing behavior 
will be more natural, subjects are told they are evaluating the programming, not the ads. 


Monitoring Web Site Traffic 


Computer technology makes gathering detailed data about online behavior easy and inexpensive. 
The greater challenges are to identify which measures are meaningful and to interpret the data cor- 
rectly. For instance, most organizations record the number of hits at their Web sites—mouse clicks 
on a single page of a Web site. If the visitor clicks on many links, that page receives multiple hits. 
Similarly, they can track page views, or single, discrete clicks to load individual pages of a Web site. 
Page views more conservatively indicate how many users visit each individual page on the Web 
site and may also be used to track the path or sequence of pages that each visitor follows. 


CLICK-THROUGH RATES 


A click-through rate (CTR) is the percentage of people who are exposed to an advertisement 
who actually click on the corresponding hyperlink which takes them to the company’s Web site. 
Counting hits or page views can suggest the amount of interest or attention a Web site is receiv- 
ing, but these measures are flawed. First, hits do not differentiate between a lot of activity by a few 
visitors and a little activity by many visitors. In addition, the researcher lacks information about 
the meaning behind the numbers. If a user clicks on a site many times, is the person finding a lot 
of useful or enjoyable material, or is the user trying unsuccessfully to find something by looking 
in several places? Additionally, some hits are likely made by mistake. The consumers may have 
had no intention of clicking through the ad or may not have known what they were doing when 
they clicked on the ad. 

A more refined count is the number of unique visitors to a Web site. This measurement counts 
the initial access to the site but not multiple hits on the site by the same visitor during the same 
day or week. Operators of Web sites can collect the data by attaching small files, called cookies, to 
the computers of visitors to their sites and then tracking those cookies to see whether the same 
visitors return. Some research companies, notably Jupiter Research and Nielsen//NetRatings, 
specialize in monitoring this type of Internet activity. A typical approach is to install a special 
tracking program on the personal computers of a sample of Internet users who agree to participate 
in the research effort. Nielsen//NetRatings has its software installed in thirty thousand computers 
in homes and workplaces. Internet monitoring enables these companies to identify the popularity 
of Web sites. In recent years, accurate measurement of unique visitors has become more difficult, 
because over half of computer users have deleted cookies and many users block cookies to make 
themselves anonymous.’ 

As online advertising has become commonplace, business research has refined methods for 
measuring the effectiveness of the advertisements. The companies that place these ads can keep 
count of the click-through rate (CTR). Applying the CTR to the amount spent on the adver- 
tisement gives the advertiser a cost per click. These measures have been hailed as a practical way to 
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click-through rate 


Proportion of people who are 
exposed to an Internet ad who 
actually click on its hyperlink to 
enter the Web site; click-through 
rates are generally very low. 
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scanner-based consumer 
panel 


A type of consumer panel in 
which participants’ purchasing 
habits are recorded with a laser 
scanner rather than a purchase 

diary. 
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evaluate advertising effectiveness. However, marketers have to consider that getting consumers to 
click on an ad is rarely the ad’s objective. Companies are more often advertising to meet short- or 
long-term sales goals. 

Google has benefited from CTR research indicating that the highest click-through rates tend 
to occur on pages displaying search results. (Not surprisingly, someone who searches for the 
term kayaks is more likely to be interested in an advertisement offering a good deal on kayaks.) 
The company showed Vanguard, for example, that its banner ads cost the financial firm less than 
50 cents per click and generated a 14 percent click-through rate. That CTR is far above typical 
response rates for direct-mail advertising, but it does not indicate whether online clicks are as 
valuable in terms of sales. ° 


Scanner-Based Research 


Lasers performing optical character recognition and barcode technology like the universal product 
code (UPC) have accelerated the use of mechanical observation in business research. Chapter 8 
noted that a number of syndicated services offer secondary data about product category movement 
generated from retail stores using scanner technology. 

This technology allows researchers to investigate questions that are demographically or pro- 
motionally specific. Scanner research has investigated the different ways consumers respond to 
price promotions and the effects of those differences on a promotion’s profitability. One of the 
primary means of implementing this type of research is through the establishment of a scanner- 
based consumer panel to replace consumer purchase diaries. In a typical scanner panel, each house- 
hold is assigned a bar-coded card, like a frequent-shopper card, which members present to the 
clerk at the register. The household’s code number is coupled with the purchase information 
recorded by the scanner. In addition, as with other consumer panels, background information 
about the household obtained through answers to a battery of demographic and psychographic 
survey questions can also be coupled with the household code number. 

Aggregate data, such as actual store sales as measured by scanners, are available to clients 
and industry groups. Data may also be aggregated by product category. To interpret the aggre- 
gated data, researchers can combine them with secondary research and panel demographics. For 
instance, data from Information Resources Inc. (IRI) have indicated a downward trend in sales 
of hair-coloring products. Demographic data suggest that an important reason is the aging of the 
population; many consumers who dye their hair reach an age at which they no longer wish to 
cover their gray hair. A smaller segment of the population is at an age where consumers typically 
begin using hair coloring.'! 

Data from scanner research parallel data provided by a standard mail diary panel, with some 
important improvements: 


1. The data measure observed (actual) purchase behavior rather than reported behavior (recorded 
later in a diary). 

2. Substituting mechanical for human record-keeping improves accuracy. 

3. Measures are unobtrusive, eliminating interviewing and the possibility of social desirability or 
other bias on the part of respondents. 

4. More extensive purchase data can be collected, because all UPC categories are measured. In a 
mail diary, respondents could not possibly reliably record all items they purchased. Because all 
UPC-coded items are measured in the panel, users can investigate many product categories to 
determine loyalty, switching rates, and so on for their own brands as well as for other compa- 
nies’ products and locate product categories for possible market entry. 

5. The data collected from computerized checkout scanners can be combined with data about 
the timing of advertising, price changes, displays, and special sales promotions. Researchers can 
scrutinize them with powerful analytical software provided by the scanner data providers. 


Scanner data can show a researcher week-by-week how a product is doing, even in a single store, 
and track sales in response to changes of sales personnel, local advertising, or price promotions. 
Also, several organizations have developed scanner panels, such as Information Resources Inc.’s 
Behavior Scan System, and expanded them into electronic test-market systems. 
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/ Neuroco Peers into the 

Consumer's Brain 

When Hewlett-Packard was develop- 
ing advertisements for its digital photography 
products, the firm wanted to ensure its ad images 
would evoke the desired response. For guidance, the company 
turned to Neuroco and its high-tech research method, known 
as neuromarketing. Neuroco researchers showed subjects a pair 
of photos of the same woman, and about half of them preferred 
each picture. Then Neuroco measured the electrical activity in 
the brains of subjects looking at the same images, and the analy- 
sis showed a definite preference for one of the pictures in which 
the woman’s smile was a little warmer. 

Neuroco’s approach uses a technology called quantified elec- 

troencephalography (QEEG). Subjects wear light and portable EEG 
equipment that records brain activity; software presents the data 


suring equipment can travel with subjects as they walk around a 
store or watch advertisements. 

Consider a young woman demonstrating a Neuroco study 
by shopping with electrodes discreetly attached to her head. 
Neuroco chief scientist David Lewis observes a computer 
screen showing a map of her brain waves in red and green, with 
the colors signaling levels of alpha-wave activity. The zigzag 
pattern tells Lewis that this shopper is alert but not engaged in 
making purchase decisions. As the woman walks into a store’s 
shoe department, however, the pattern changes when she picks 
up a pair of stiletto heels. An explosion of brain activity occurs, 
then the woman heads for the cash register, decision made. 

As this example illustrates, observation can provide tremendous 
insight to businesses. Advances in observation technology are liter- 
ally providing a view of what is 
happening inside the brain. 


in computer maps that display activity levels in areas of the brain. 
Researchers can then evaluate whether the person is attentive 
and whether brain activity signifies emotional involvement or 
analytical thinking. QEEG is more flexible than the better-known 
use of functional magnetic resonance imaging (fMRI), which 

has provided many advances in brain research but requires all 
subjects to lie still in a large, noisy machine. With QEEG, the mea- 


Source: Based on Mucha, Thomas, 

“This Is Your Brain on Advertising,” 
Business 2.0 (August 2005), downloaded 
from http://web2.infotrac.galegroup. 
com; and Laybourne, Peter, and David 
Lewis, “Neuromarketing: The Future 

of Consumer Research?” Admap (May 
2005), 28-30. 


Measuring Physiological Reactions 


Researchers have used a number of mechanical devices to evaluate physical and physiological 
reactions to advertising copy, packaging, and other stimuli. Researchers use such means when they 
believe consumers are unaware of their own reactions to stimuli such as advertising or that consumers 
will not provide honest responses. Recent research approaches use devices to monitor and measure 
brain activity as described in the Research Snapshot above. Four major categories of mechanical 
devices are used to measure physiological reactions: (1) eye-tracking monitors, (2) pupilometers, 
(3) psychogalvanometers, and (4) voice-pitch analyzers. 

A magazine or newspaper advertiser may wish to grab readers’ attention with a visual scene 
and then direct it to a package or coupon. Or a television advertiser may wish to identify which 
selling points to emphasize. Eye-tracking equipment records how the subject reads a print ad or 
views a television commercial and how much time is spent looking at various parts of the stimu- 
lus. In physiological terms, the gaze movement of a viewer’s eye is measured with an eye-tracking 
monitor, which measures unconscious eye movements. Originally developed to measure astronauts’ 
eye fatigue, modern eye-tracking systems need not keep a viewer’s head in a stationary position. 
The devices track eye movements with invisible infrared light beams that lock onto a subject’s 
eyes. The light reflects off the eye, and eye-movement data are recorded while another tiny video 
camera monitors which magazine page is being perused. The data are analyzed by computer to 
determine which components in an ad (or other stimuli) were seen and which were overlooked. 
Eye-tracking monitors have recently been used to measure the way subjects view e-mail and Web 
messages. OgilvyOne has used this technology to learn that people often skip over more than half 
of the words in e-mail advertising, especially words on the right side of the message. Interestingly, 
consumers generally ignore the word free.’ 

Other physiological observation techniques are based on a common principle: that adrena- 
line is released when the body is aroused. This hormone causes the heart to enlarge and to beat 


eye-tracking monitor 


A mechanical device used to 


observe eye movements; some 
eye monitors use infrared light 
beams to measure unconscious 


eye movements. 
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Physiological responses to 
advertising can be recorded 
with a device like this one. 


pupilometer 


A mechanical device used to 
observe and record changes in 
the diameter of a subject's pupils. 


psychogalvanometer 


A device that measures galvanic 
skin response, a measure of invol- 
untary changes in the electrical 
resistance of the skin. 


voice-pitch analysis 


A physiological measurement 
technique that records abnormal 
frequencies in the voice that are 
supposed to reflect emotional 
reactions to various stimuli. 
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harder and faster. These changes 
increase the flow of blood to 
the fingers and toes. The blood 
vessels dilate, and perspiration 
increases, affecting the skin’s elec- 
trical conductivity. Other physical 
changes following the release of 
adrenaline include dilation of the 
pupils, more frequent brain wave 
activity, higher skin temperature, 
and faster breathing. Methods that 
measure these and other changes 
associated with arousal can apply 
to a variety of business questions, 
such as subjects’ reactions to 
advertising messages or product 
concepts. 

A pupilometer observes and 
records changes in the diameter 
of a subject’s pupils. A subject is 
instructed to look at a screen on 
which an advertisement or other stimulus is projected. When the brightness and distance of 
the stimulus from the subject’s eyes are held constant, changes in pupil size may be inter- 
preted as changes in cognitive activity that result from the stimulus, rather than from eye 
dilation and constriction in response to light intensity, distance from the object, or other 
physiological reactions to the conditions of observation. This method of research is based 
on the assumption that increased pupil size reflects positive attitudes toward and interest in 
advertisements. 

A psychogalvanometer measures galvanic skin response (GSR), a measure of involun- 
tary changes in the electrical resistance of the skin. This device is based on the assumption 
that physiological changes, such as increased perspiration, accompany emotional reactions 
to advertisements, packages, and slogans. Excitement increases the body’s perspiration rate, 
which increases the electrical resistance of the skin. The test is an indicator of emotional 
arousal or tension. 

Voice-pitch analysis is a relatively new physiological measurement technique that gauges emo- 
tional reactions as reflected in physiological changes in a person’s voice. Abnormal frequencies in 
the voice caused by changes in the autonomic nervous system are measured with sophisticated, 
audio-adapted computer equipment. Computerized analysis compares the respondent’s voice 
pitch during warm-up conversations (normal range) with verbal responses to questions about his 
or her evaluative reaction to television commercials or other stimuli. This technique, unlike other 
physiological devices, does not require the researcher to surround subjects with mazes of wires or 
equipment. 

All of these devices assume that physiological reactions are associated with persuasiveness or 
predict some cognitive response. This assumption has not yet been clearly demonstrated. No 
strong theoretical evidence supports the argument that such a physiological change is a valid 
measure of future sales, attitude change, or emotional response. Another major problem with 
physiological research is the calibration, or sensitivity, of measuring devices. Identifying arousal is 
one thing, but precisely measuring levels of arousal is another. In addition, most of these devices 
are expensive. However, as a prominent researcher points out, physiological measurement is coin- 
cidental: “Physiological measurement isn’t an exit interview. It’s not dependent on what was 
remembered later on. It’s a live blood, sweat, and tears, moment-by-moment response, synchro- 
nous with the stimulus.” 

Each of these mechanical devices has another limitation: The subjects are usually placed in 
artificial settings, such as watching television in a laboratory rather than at home, and the partici- 
pants know they are being observed. 
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e While observation is a powerful and e Other forms of bias may be present. 


potentially useful research methodology, e Observer bias results from the cognitive or behav- 
any insight is limited to the observable. ioral actions of the observer as they rely on their own 
e Observation may not be used for cognitive interpretation. 
phenomena. Attitudes, motivations, expectations, e If researchers only record what they see, observation is one of 
intentions, and preferences are not observable; only the most unbiased methods for collecting data. If researchers 
overt behavior of short duration can be observed. go beyond what they see—offering personal interpretation 


e Observation can eliminate some forms of bias. 
e Common survey bias from distortions, inaccuracies, or research technique. 
other response biases due to memory error, social desir- 
ability bias, and so forth are not present. 


Summary 


1. Discuss the role of observation as a business research method. Observation is a powerful tool 
for the business researcher. Scientific observation is the systematic process of recording the behav- 
ioral patterns of people, objects, and occurrences as they are witnessed. Questioning or otherwise 
communicating with subjects does not occur. A wide variety of information about the behavior of 
people and objects can be observed. Seven kinds of phenomena are observable: physical actions, ver- 
bal behavior, expressive behavior, spatial relations and locations, temporal patterns, physical objects, 
and verbal and pictorial records. Thus, both verbal and nonverbal behavior may be observed. 


2. Describe the use of direct observation and contrived observation. Human observation, 
whether direct or contrived, is commonly used when the situation or behavior to be recorded is 
not easily predictable in advance of the research. It may be unobtrusive, and many types of data 
can be obtained more accurately through direct observation than by questioning respondents. 
Direct observation involves watching and recording what naturally occurs, without creating an 
artificial situation. For some data, observation is the most direct or the only method of collection. 
For example, researchers can measure response latency, the time it takes individuals to choose 
between alternatives. Observation can also be contrived by creating the situations to be observed, 
such as with a mystery shopper or a research laboratory. This can reduce the time and expense of 
obtaining reactions to certain circumstances. 


3. Identify ethical issues in observation studies. Contrived observation, hidden observation, and 
other observation research designs have the potential to involve deception. For this reason, these 
methods often raise ethical concerns about subjects’ right to privacy and right to be informed. 
We mentioned three questions to help determine the ethicality of observation: (1) is the behavior 
being observed commonly performed in public where others can observe it, (2) is anonymity of 
the subject assured, and (3) has the subject agreed to be observed? If the answers to 1 and 2 are 
“yes,” or if the answer to 3 is “yes, the observation is likely ethical. 


4. Explain the observation of physical objects and message content. Physical-trace evidence 
serves as a visible record of past events. Researchers may examine whatever evidence provides 
such a record, including inventory levels, the contents of garbage cans, or the items in a consumer’s 
pantry. Content analysis obtains data by observing and analyzing the contents of the messages in 
written or spoken communications. 


5. Describe major types of mechanical observation. Mechanical observation uses a variety of 
devices to record behavior directly. It may be an efficient and accurate choice when the situation 
or behavior to be recorded is routine, repetitive, or programmatic. National television audience 
ratings are based on mechanical observation (for example, Nielsen’s PeopleMeters) and comput- 
erized data collection. Web site traffic may be measured electronically. Scanner-based research 
provides product category sales data recorded by laser scanners in retail stores. Many syndicated 
services offer secondary data collected through scanner systems. 


6. Summarize techniques for measuring physiological reactions. Physiological reactions, such 
as arousal or eye movement patterns, may be observed using a number of mechanical devices. 


of the events—observation can be an extremely biased 
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Eye-tracking monitors identify the direction of a person’s gaze, and a pupilometer observes and 
records changes in the diameter of the pupils of subjects’ eyes, based on the assumption that a 
larger pupil signifies a positive attitude. A psychogalvanometer measures galvanic skin response 
as a signal of a person’s emotional reactions. Voice-pitch analysis measures changes in a person’s 
voice and associates the changes with emotional response. 


Key Terms and Concepts 


click-through rate, 249 
content analysis, 246 
contrived observation, 244 
direct observation, 242 
eye-tracking monitor, 251 


observation, 239 
observer bias, 243 


pupilometer, 252 


hidden observation, 240 


psychogalvanometer, 252 


response latency, 243 
scanner-based consumer panel, 250 
television monitoring, 247 

visible observation, 240 
voice-pitch analysis, 252 


Questions for Review and Critical Thinking 


Yogi Berra, former New York Yankee catcher, said, “You can 

observe a lot just by watching.” How does this fit in with the 

definition of scientific observation? 

What are the advantages and disadvantages of observation stud- 

ies relative to surveys? 

Under what conditions are observation studies most 

appropriate? 

ETHICS The chapter showed a photograph of a traffic monitor- 

ing camera. Do you think the use of these cameras to issue 

speeding tickets is ethical? What types of behavior might cam- 

eras like these capture that would help automobile designers 

produce products that better match our needs as drivers? 

A multinational fast-food corporation plans to locate a restau- 

rant in La Paz, Bolivia. Secondary data for this city are sketchy 

and outdated. How might you determine the best location 

using observation? 

Discuss how an observation study might be combined with a 

personal interview. 

‘NET Click-through rates for advertisements placed in Web sites 

are usually very, very low (less than 1 percent). What types of 

error might exist in using click-through rate data as a measure 

of an ad’s success? 

Outline a research design using observation for each of the fol- 

lowing situations: 

a. A bank wishes to collect data on the number of customer 
services and the frequency of customer use of these services. 

b. A state government wishes to determine the driving pub- 
lic’s use of seat belts. 

c. A researcher wishes to know how many women have been 
featured on Time covers over the years. 


Research Activities 


"NET William Rathje, a researcher at the University of Arizona, 
Department of Anthropology, has become well-known for 

the “Garbage Project.” The project involves observational 
research. Use http://www.ask.com to find information about the 
garbage project at the University of Arizona. What is the name 
of the book that describes some of the key findings of the 


10. 
11. 
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d. A human resource manager wants to know what salaries their 
key competitors are offering for some common positions. 

e. A fast-food restaurant manger wishes to determine if they 
serve their customers as quickly as their competitors. 

f. A magazine publisher wishes to determine exactly what 
people look at and what they pass over while reading one 
of its magazines. 

g. An overnight package delivery service wishes to observe 
delivery workers beginning at the moment when they stop 
the truck, continuing through the delivery of the package, 
and ending when they return to the truck. 

What is a scanner-based consumer panel? 

What are the major types of mechanical observation? 

ETHICS Comment on the ethics of the following situations: 

a. During the course of telephone calls to investors, a stock- 
broker records respondents’ voices when they are answer- 
ing sensitive investment questions and then conducts a 
voice pitch analysis. The respondents do not know that 
their voices are being recorded. 

b. A researcher plans to invite consumers to be test users in a 
simulated kitchen located in a shopping mall and then to 
videotape their reactions to a new microwave dinner from 
behind a two-way mirror (one that an observer behind the 
mirror can see through but the person looking into the 
mirror sees only the reflection). 

c. A researcher arranges to purchase the trash from the head- 
quarters of a major competitor. The purpose is to sift 
through discarded documents to determine the company’s 
strategic plans. 

What is a psychogalvanometer? 


Garbage Project? How do you think it involves observational 
research? 

‘NET The Internet is filled with Webcams. For example, 
Pebble Beach Golf Club has several Webcams (http://www 
.pebblebeach.com). How could a researcher use Webcams like 
these to collect behavioral data? 


Chapter 11: Observation Methods 
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Case 11.1 Mazda and Syzygy 
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| When Mazda Motor Europe set out to improve 
its Web site, the company wanted details about 


how consumers were using the site and whether 
finding information was easy. Mazda hired a 
research firm called Syzygy to answer those 


PHOTODISC GREEN 


d questions with observational research.'* Syzygy’s 
methods include the use of an eye-tracking device that uses infrared 
light rays to record what areas of a computer screen a user is view- 
ing. For instance, the device measured the process computer users 
followed in order to look for a local dealer or arranging a test drive. 
Whenever a process seemed confusing or difficult, the company 
looked for ways to make the Web site easier to navigate. 

To conduct this observational study, Syzygy arranged for 
16 subjects in Germany and the United Kingdom to be observed 
as they used the Web site. The subjects in Germany were observed 


with the eye-tracking equipment. As the equipment measured each 
subject’s gaze, software recorded the location on the screen and 
graphed the data. Syzygy’s results included three-dimensional 
contour maps highlighting the “peak” areas where most of the 
computer users’ attention was directed. 


Questions 

1. What could Mazda learn from eye-tracking software that would 
be difficult to learn from other observational methods? 

What are the shortcomings of this method? 

Along with the eye-tracking research, what other research 
methods could help Mazda assess the usability of its Web site? 
Summarize your advice for how Mazda could use complemen- 


oN 


tary methods to obtain a complete understanding of its Web 
site usability. 


Case 11.2 Texas Instruments and E-Lab 
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E-Lab, LLC is a business research and design firm 
in Chicago that specializes in observing people, 
identifying patterns in behavior, and developing 
an understanding of why these patterns exist." 
The company then uses the knowledge that it 


[gains as a framework in the product develop- 
ment process. Texas Instruments (TI) used E-Lab to investigate the 
mobility, connectivity, and communications needs of law enforce- 
ment officers, which led to ideas for a set of computing and com- 
munications products. As part of its product development research, 
TI’s Advanced Integrated Systems Department and E-Lab research- 
ers spent 320 hours shadowing police officers in three Texas police 
departments. Shadowing involves asking questions while observing. 
Researchers walked foot patrols, rode in patrol cars, and pedaled 
with bike patrols. They spent time with crowd control, narcotics, 
homicide, dispatch, and juvenile teams. They recorded their obser- 
vations and interviews on paper, digital camera, and video. 

A number of interesting findings emerged from all this research. 
First, police officers are very social, so it was important that any 


product TI developed should enhance socialization rather than 
detract from it. For example, an in-car computing and communica- 
tions device should be able to access a database that lists names and 
numbers of experts on the force so officers can call or e-mail the 
experts directly. Second, police officers are not driven by proce- 
dure. That told TI that the procedures for an investigation should 
reside in the device and that the device should prompt the officer at 
each step in the process. And third, officers rely on informal infor- 
mation about people and activities on their beats. This information 
may be kept on scraps of paper, on a spreadsheet back in the office, 
or in the police officer’s head. Business researchers concluded that 
any device that TI develops should have a place to compile and 
share informal information. 


Questions 

1. Identify the research design used by E-Lab. 

2. Compare this research design with a survey research design. 
What advantages, if any, did this research design have over a 
survey? 


CHAPTER 12 
EXPERIMENTAL 
RESEARCH 


After studying this chapter, you should be able to 


1. Identify the independent variable, dependent variable, 
and construct a valid simple experiment to assess a cause 


and effect relationship 
2. Understand and minimize systematic experimental error 
3. Know ways of minimizing experimental demand 
characteristics 
4. Avoid unethical experimental practices 
5. Understand the advantages of a between-subjects 
experimental design 
6. Weigh the trade-off between internal and external validity 
7. Use manipulations to implement a completely random- 
ized experimental design, a randomized-block design, 
and a factorial experimental design 


Chapter Vignette: Testing Web Protocols 
for Financial Markets 


Technological advances have drastically changed the way we conduct banking and related 

financial services. ATMs, online banking, real-time stock trading, and other Web services have 
created a globally accessible 24-hour-a-day financial market. For most of 

poms | Sane : us, how this happens is not that relevant. However, for infor- 

mation technology directors and financial managers, how 

this process occurs—and how to make it occur faster and 

cheaper—is vitally important. This vignette describes an experi- 

ment examining two protocols for transferring information over 


computer networks. 
FIX (Financial Information eXchange) is the commonly used 


electronics communication protocol for global real-time infor- 

mation exchange for securities transactions and markets. With 
the annual volume of trade in trillions of dollars, financial service 
firms are constantly seeking ways to cost-effectively increase the 
speed of access to financial markets. SOAP (Simple Object Access 
Protocol) is a potential competitor for the FIX method of informa- 
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c tion exchange. 
Researchers designed a laboratory experiment to compare the 
relative performance of FIX and SOAP in business computing scenarios.! By creating identi- 
cal conditions—transferring the same information, using the same computers, over the same 
Ethernet connection—the performance of the two protocols was assessed. The researchers 
measured the time it took for a round-trip message from the client to the server and back. The 
results indicate that FIX remains a faster protocol for transferring financial market information. 
While most of us do not fully understand the difference between FIX and SOAP—and even fewer 
really care—it is not necessary for us to understand the purpose of the experiment. This experi- 
ment answers an important question to the financial world “How does the performance of these 
two approaches compare?” However, an understanding of the process of testing these two 
approaches is very important to business researchers. This chapter provides a basic understand- 


ing of experimental business research. 
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Introduction 


Most students are familiar with scientific experiments from studying physical sciences like 
physics and chemistry. The term experiment typically conjures up an image of a chemist 
surrounded by bubbling test tubes and Bunsen burners. Behavioral and physical scientists 
have used experimentation far longer than have business researchers. Nevertheless, both social 
scientists and physical scientists use experiments for much the same purpose—to assess cause 
and effect relationships. 


Creating an Experiment 


As described in an earlier chapter, experiments are widely used in causal research designs. Experi- 
mental research allows a researcher to control the research situation so that causal relationships 
among variables may be evaluated. The experimenter manipulates one or more independent vari- 
ables and holds constant all other possible independent variables while observing effects on depen- 
dent variable(s). Events may be controlled in an experiment to a degree that is simply not possible 
in a survey. 

Independent variables are expected to determine the outcomes of interest. In an experiment, 
they are controlled by the researcher through manipulations. Dependent variables are the out- 
comes of interest to the researcher and the decision makers. A simple example would be thinking 
about how changes in price would influence sales. Price would be an independent variable and 
sales would be a dependent variable. In our opening vignette, the protocol used (FIX or SOAP) 
would be an experimental manipulation—the independent variable—and the speed of data trans- 
mission is the important dependent variable. 

The researcher’s goal in conducting an experiment is to determine whether changing an 
experimental independent variable causes changes in the specified dependent variable. The 
assumption of the experiment described above is that the type of protocol used will affect the 
speed of financial data transfer. In other words, changing from FIX to SOAP will increase or 
decrease the time required for data transfer. If all the other conditions are the same, then a causal 
inference is supported. 

A famous experiment in the marketing field investigated the influence of brand name on con- 
sumers’ taste perceptions. An experimenter manipulated whether consumers preferred the taste 
of beer in labeled or unlabeled bottles. One week respondents were given a six-pack containing 
bottles labeled only with letters (A, B, C). The following week, respondents received another 
six-pack with brand labels (like Budweiser, Coors, Miller, and so forth). The experimenter mea- 
sured reactions to the beers after each tasting. In every case, the beer itself was the same. So, every 
person involved in the experiment drank the very same beer. Therefore, the differences observed 
in taste, the key dependent variable, could only be attributable to the difference in labeling. 
When the consumers participating in the experiment expressed a preference for the branded 
beer, the conclusion is that brand name does influence consumers’ taste perceptions. 


An Illustration: Can a Self-Efficacy 
Intervention Enhance Job Attitude? 


This chapter deals with business experiments, which can best be illustrated 
through examples like the opening vignette and the one which follows. We 
will refer back to these examples throughout the chapter. 

Let’s take a look at an experiment investigating how self-efficacy might 
influence an employee’s attitude toward their job. Self-efficacy is a per- 
son’s confidence and belief in their own abilities to accomplish the tasks at 
hand. While the subjects of this particular research are accountants, and the 
results are highly relevant for those involved in fields like human resource 
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An experiment can capture 
whether or not mangers can 
increase self-efficacy and 
enhance employee attitudes 
toward their job. 
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COURTESY OF QUALTRICS.COM 


The screenshot here shows the edit view from the Qualtrics Web 
site interface. The survey asked respondents several questions 


once a month 


Marketing work does not 
interfere with your ° 
personal life 


Q109 


Strongly 
Disagree 


Management work is easy fe) 
Management 


professionals work more (0) 
than 40 hours a week 


subjects 


The sampling units for an experi- 
ment, usually human respondents 
who provide measures based on 
the experimental manipulation. 


blocking variables 


A categorical (less than interval) 
variable that is not manipulated 
as is an experimental variable but 
is included in the statistical 
analysis of experiments 


experimental condition 


One of the possible levels of 
an experimental variable 
manipulation 


258 


Please rate your agreement with each of the statements below as they pertain to a career in management. 


Disagree 


about prospective careers. Notice that we’ve 

included questions about marketing and man- 
agement (near the bottom of the screenshot). 
However, each subject only responded to a 
single occupation (marketing, management, 
finance, or accounting). This actually repre- 
sents a very simple experimental design in which the type of 
occupation described may cause the subjects’ responses to 
these questions. Take a look at the data and see if you can 
determine whether or not students’ beliefs about careers are 
altered by the type of occupation they were assigned to rate. 
Here, job type becomes the experimental manipulation. Do 
you know the treatment levels? 


management, it has implications for anyone in a managerial 
role. The key issue centers on a manager’s ability to raise an 


Somewhat Somewhat 
Disagree Agree 


Strongly 


Agree Agree 


employee’s confidence in their ability to perform their job 
o o o o o i 
and the favorable outcomes of this increased confidence. 


° © (0) © [9] 


EXPERIMENTAL SUBJECTS 


This experiment involved actual employees of an account- 

ing firm. Seventy-one first and second year auditors of one 
major accounting firm participated in the study. Participants in experimental research are referred 
to as subjects rather than respondents. This is because the experimenter subjects them to some 
experimental treatment. In this experiment, 35 of the subjects were given positive feedback and 
encouragement from their supervisors as the experimental treatment. The other 36 subjects were 
not provided the positive feedback. 


INDEPENDENT VARIABLES 


The experiment involved one relevant independent variable, whether or not the employee 
received the positive feedback intended to enhance their self-efficacy. Employees receiving the 
experimental treatment participated in an interview and received three different pieces of written 
communication from their supervisors providing encouragement and expressing confidence that 
they would be successful in their positions. 

While not a true independent variable, the length of time each employee had worked 
with the firm was also important to the researchers. Could new employees react differently 
to the positive feedback than employees who had already been with the firm? In this case, 
length of time cannot be manipulated by the researchers, but it can still be considered in the 
experiment. Variables such as this (another example would be the sex of the experimen- 
tal subject) are referred to as blocking variables, which are discussed in more detail later in 
this chapter. Considering the independent variable (treatment or no treatment) and the 
blocking variable (new or current employee), four different experimental cells are possible. 
Exhibit 12.1 illustrates the four different experimental conditions for this experiment. 
An experimental condition refers to one of the possible levels of an experimental variable 
manipulation. 

Subjects were divided into “newcomers” (the new employees) and “insiders” (current 
employees) and then randomly assigned to either the treatment condition or the control group. 
By analyzing differences between the groups, the researcher can see what effects occur due to the 
independent and blocking variables. 
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EXHIBIT 12.1 
Experimental Treatment Experimental Conditions in 
SSeS Self-Efficacy Experiment 
Blocking Variable No Feedback Received Feedback 


Newcomers 

(New Employees) 
Employment 

Insiders 

(Current Employees) 


E EXPERIMENTAL OUTCOME 


The key outcomes, or dependent variables, in this example are a subject’s job satisfaction, organi- 
zational commitment, professional commitment, intent to quit the organization, and intent to quit 
the profession. In addition, the researchers followed up later to see if the subjects had actually left 
the firm. For simplicity, we will only look at the effect on one dependent variable, job satisfaction. 
In this case, subjects were asked to respond to a rating scale asking how much they agreed with a 
series of statements regarding their satisfaction with their job. The possible scores ranged from 1 
to 7, where a higher score means higher job satisfaction. 

Exhibit 12.2 shows the average for each experimental condition. The results show that 
after receiving the positive feedback and encouragement, subjects that were already work- 
ing for the firm reported an average job satisfaction score of 5.45, while the new employees 
that received the treatment reported an average score of 5.93. For those subjects that did not 


receive the treatment, the current employees’ average scores was 4.77 and the new employee’s 
average was 5.80. 


EXHIBIT 12.2 
Experimental Treatment Job Satisfaction Means in 


Self-Efficacy Experiment 
Blocking No Received 


Variable Feedback Feedback 


Newcomers 5.87 
(New Employees) 

Employment 
Insiders 5.10 


(Current Employees) 


5.38 5.68 


Thus, the conclusion at this point seems to be that the difference in job satisfaction is primarily 
between the current and new employees. The self-efficacy treatment does not seem to have much 
impact. Or does it? 


E INDEPENDENT VARIABLE MAIN EFFECTS AND INTERACTION 


The length of time that the employee works at the firm clearly appears to matter. But maybe the 
attempts to enhance self-efficacy shouldn’t be dismissed so quickly. The researcher must examine 
both the effects of each experimental variable considered alone and the effects due to combina- main effect 


tions of variables. A main effect refers to the experimental difference in means between the differ- Fhe experimentalditrerenc 
ent levels of any single experimental variable. In this case, there are potential main effects for the in dependent variable means 
self-efficacy treatment and for the length of time as an employee, but only the differences associ- between the different levels of 


ated with employment length are significant (at a .05 level). any single experimental variable. 
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interaction effect 


Differences in dependent vari- 
able means due to a specific 
combination of independent 

variables. 


Experimental Graph Showing 
Results within Each Condition 


Part 3: Research Methods for Collecting Primary Data 


An interaction effect is due to a specific combination of independent variables. In this case, 
it’s possible that the combination of length of employment and the self-efficacy treatment creates 
effects that are not clearly represented in the main effects. Interaction results are often shown with 
a line graph as shown in Exhibit 12.3. Main effects are illustrated when the lines are at different 
heights as is the case here. Notice the line for new employees is higher than the line for current 
employees. When the lines have very different slopes, an interaction is likely present. In this case, 
the combination of length of employment and self-efficacy treatment is presenting an interaction 
leading to the following interpretation. 


7.0 


6.5 


6.0 


35 


5.0 


Self-Efficacy 


4.5 


4.0 


3.5 


3.0 


No Feedback Received Feedback 


—?#— New Employee -—®— Current Employee 


The worst situation is the current employees who do not receive positive feedback. Conversely, 
the best scenario regarding job satisfaction occurs when the treatment is given to new employees. It 
also appears that job satisfaction tends to decrease over time. The benefit of the self-efficacy treat- 
ment is greater for the employees that have been with the organization than for new employees. In 
other words, it appears that the self-efficacy treatment helps prevent the decline in job satisfaction. 


Designing an Experiment to 
Minimize Experimental Error 


Experimental design is a major research topic. In fact, there are courses and books devoted only 
to that topic.’ Here, an introduction into experimental design is provided. A student should be 
able to design and implement basic experimental designs with this introduction. Fortunately, most 
experimental designs for business research are relatively simple. 

Experimental designs involve no less than four important design elements. These issues include 
(1) manipulation of the independent variable(s); (2) selection and measurement of the dependent 
variable(s); (3) selection and assignment of experimental subjects; and (4) control over extraneous 
variables.* Each element can be implemented in a way that helps minimize error. 


Manipulation of the Independent Variable 


The thing that makes independent variables special in experimentation is that the researcher actu- 
ally creates his or her values. This is how the researcher manipulates, and therefore controls, 
independent variables. In the financial market protocol experiment, the researchers decided to test 
different protocols. In the self-efficacy example, the researchers chose to provide some employees 


Chapter 12: Experimental Research 


with positive feedback and not 
give the same encouragement to 
others. Experimental independent 
variables are hypothesized to be 
causal influences. Therefore, exper- 
iments are very appropriate in causal 
designs. 

An experimental treatment is 
the term referring to the way an 
experimental variable is manip- 
ulated. For example, the open- 
ing vignette manipulated the 
protocol by choosing FIX and 
SOAP for their test. In the self- 
efficacy study, the researchers 
had a personal interview with 
the employees and then had the 
supervisors send three encour- 
aging letters to manipulate self- 
efficacy. Similarly, a medical 
researcher may manipulate an 
experimental variable by treating some subjects with one drug and the other subjects with a 
separate drug. Experimental variables often involve treatments with more than two levels. For 
instance, prices of $1.29, $1.69, and $1.99 might represent treatments in a pricing experiment 
examining how price affects sales. 

Experimental variables like these can not only be described as independent variables, but they 
also can be described as a categorical variable because they take on a value to represent some classifiable 
or qualitative aspect. Protocol, for example, is either FIX or SOAP. The employees either received 
the feedback or they did not. In other situations an independent variable may truly be a continuous 
variable. For example, the pricing experiment mentioned above could involve any price levels. The 
task for the researcher is to select appropriate levels of that variable as experimental treatments. For 
example, consumers might not perceive a difference between $1.24 and $1.29, but likely will notice 
the difference between $1.29 and $1.69. Before conducting the experiment, the researcher decides 
on levels that would be relevant to study. The levels should be noticeably different and realistic. 


EXPERIMENTAL AND CONTROL GROUPS 


In perhaps the simplest experiment, an independent variable is manipulated over two treatment 
levels resulting in two groups, an experimental group and a control group. An experimental 
group is one in which an experimental treatment is administered. A control group is one in 
which no experimental treatment is administered. In our self-efficacy example, the experimen- 
tal group is comprised of the subjects that received the positive feedback. The control group 
did not receive the additional positive feedback designed to enhance self-efficacy. By holding 
conditions constant in the control group, the researcher controls for potential sources of error 
in the experiment. Job satisfaction (the dependent variable) in the two groups was compared at 
the end of the experiment to determine whether the encouragement (the independent variable) 
had any effect. 


SEVERAL EXPERIMENTAL TREATMENT LEVELS 


An experiment with one experimental and one control group may not tell a manager everything 
he or she wishes to know. If an advertiser wished to understand the functional nature of the rela- 
tionship between advertising and sales at several treatment levels, additional experimental groups 
with annual advertising expenditures of $250,000, $500,000, $750,000, and $1 million might be 
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Business research involving 
retail stores often involves 
experiments that manipulate 
different elements of the 
physical environment. 


You never know what 
is enough unless you 
know what is more 
than enough. 

—William Blake 


We are never deceived; 
we deceive ourselves. 
—Johann Wolfgang 


von Goethe 


experimental treatment 


The term referring to the way 
an experimental variable is 
manipulated. 


experimental group 


A group of subjects to whom 
an experimental treatment is 
administered. 


control group 


A group of subjects to whom 
no experimental treatment is 
administered. 
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Does Promotion Cause Intoxication? 

One of the most pressing issues on college campuses is over- 
indulgence in alcohol. What are all of the factors that lead to 

the abuse of alcohol among undergraduate college students? 
Cultural influences such as the rite of passage can be identified in 
qualitative research. However, when it comes to setting policies 
that govern the sale of alcohol on and near universities, decision 
makers need to know what controllable practices cause drunken- 
ness among college students and what behaviors are caused by 
drunkenness. 

If heavy price promotion leads to drunkenness, which leads 
to detrimental behaviors, bars may reconsider their use and 
policy makers may consider restricting the types of promotions 
allowable if they wish to maintain their license to sell alcoholic 
beverages. These questions have led to numerous experiments. 
For instance, the type of price promotion used by bars can be 
manipulated either in the field or in a lab experiment by expos- 
ing some subjects to an ad with one type of promotion and 
exposing others to a different type of promotion. This may allow 
a test of the causal influence of promotion on alcohol consump- 
tion. These studies show results like those shown in the chart 
titled “Mean Number of Drinks.” 


Mean Number of Drinks 
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This experiment involves an experimental manipulation vary- 
ing the promotion over three levels. One-third of the student- 
subjects were exposed to each condition. The results show that 
reduced price drinks do lead 
to an increase in the number 
of drinks that a student esti- 
mates he or she would drink. 
This effect looks to be slightly 


larger among men than among women, > AN 
although women simply estimate they will J pei 
drink less than men no matter what the FA 
experimental condition. 

An experiment can also be used to show 
potentially negative results of too much drink- 
ing among college students. Researchers have designed simple 
experiments to examine how likely overdrinking is to lead a 
women to experience an unwanted sexual encounter. An experi- 
mental variable can be created that manipulates the amount of 
alcohol a student-subject actually consumes. This experiment 
can be performed in a lab environment, and one experimental 
condition could involve nonalcoholic drinking and another 
could involve heavy drinking and then asking subjects how 
likely they would be to consent to or actively resist unwanted 
sexual advances. A similar experiment showed results like those 
depicted in the chart titled “Reaction to Advances.” 


Reaction to Advances 


5 


E Sober 
E Intoxicated 


Consent Resist 


These results show that although self-reported consent is low 
in both cases (on a 1-5 scale with 5 indicating probable consent), 


it is slightly higher in the intoxicated case. There appears to be 
very little difference in self-reported aggressive resistance. Thus, 


the manipulation did not seem to affect the means on aggressive 


resistance. Other experiments looked at different interactions 
that have further implications for policy makers. Experimental 
manipulations like these are very helpful in implementing causal 
designs studying drinking related behaviors. 


Sources: Christie, J., D. Fisher, J. Kozup, S. Smith, S. Burton, and E. Creyer, “The 
Effects of Bar-Sponsored Alcohol Beverage Promotions Across Binge and Nonbinge 
Drinkers,” Journal of Public Policy and Marketing 20 (Fall 2001), 240-253; Davis, K. C., 
W. H. George, and J. Norris, “Women’s Responses to Unwanted Sexual Advances: 
The Role of Alcohol and Inhibition Conflict,” Psychology of Women Quarterly 28 
(December 2004), 333-343. 
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studied. This experiment may still involve a control variable (keeping the advertising budget for 


a region at the current level of $100,000). By analyzing more groups each with a different treat- 


ment level, a more precise result may be obtained than in a simple experimental group—control 


group experiment. This design, only manipulating the level of advertising, can produce only a 


main effect. 
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MORE THAN ONE INDEPENDENT VARIABLE 


An experiment can also be made more complicated by including the effect of another experimen- 
tal variable. Our extended example of the self-efficacy experiment would typify a still relatively 
simple two-variable experiment. Since there are two variables, each with two different levels, four 
experimental groups are obtained. Often, the term cell is used to refer to a treatment combination 
within an experiment. The number of cells involved in any experiment can be easily computed 
as follows: 


K = (1)(T))..(T,) 


m 


where K = the number of cells, T, = the number of treatment levels for experimental group 
number one, T, = the number of treatment levels for experimental group number two, and so 
forth through the mth experimental group (T ). In this case, since there are two variables each 
with two levels, the computation is quite simple: 


K=2 X2 = 4 cells 


Including multiple variables allows a comparison of experimental treatments on the dependent 
variable. Since there are more than two experimental variables, this design involves both main 
effects and interactions. 


REPEATED MEASURES 


Experiments in which an individual subject is exposed to more than one level of an experimental 
treatment are referred to as repeated measures designs. Although this approach has advantages, 
including being more economical since the same subject provides more data than otherwise, it has 
several drawbacks that can limit its usefulness. We will discuss these in more detail later. 


Selection and Measurement 
of the Dependent Variable 


Selecting dependent variables is crucial in experimental design. Unless the dependent variables are 
relevant and truly represent an outcome of interest, the experiment will not be useful. Sometimes, 
the dependent variable is fairly obvious. In the protocol example, the speed of the data exchange 
is an important and logical dependent measure. Other dependent measures, such as number of 
errors in the data transmission, may also be of relevance. In the self-efficacy study, the researchers 
did consider several dependent measures in addition to job satisfaction (organizational commit- 
ment, professional commitment, intent to quit the profession, intent to quit the organization, and 
actual turnover). In some situations, however, clearly defining the dependent variable is not so 
easy. If researchers are experimenting with different forms of advertising copy appeals, defining the 
dependent variable may be more difficult. For example, measures of advertising awareness, recall, 
changes in brand preference, or sales might be possible dependent variables. 

Choosing the right dependent variable is part of the problem definition process. Like the 
problem definition process in general, it sometimes is considered less carefully than it should be. 
The experimenter’s choice of a dependent variable determines what type of answer is given to 
assist managers in decision making. 

Consider how difficult one might find selecting the right dependent variable in an advertising 
experiment. While sales are almost certainly important, when should sales be measured? What 
about brand image or recognition? The amount of time needed for effects to become evident 
should be considered in choosing the dependent variable. Sales may be measured several months 
after the changes in advertising to determine if there were any carryover effects. Changes that are 
relatively permanent or longer lasting than changes generated only during the period of the experi- 
ment should be considered. Repeat purchase behavior may be important too, since the advertising 
may motivate some consumers to try a product once, but then never choose that product again. 
Consumers often try a “loser” once, but they do not buy a “loser” again and again. 


263 


cell 


Refers to a specific treatment 
combination associated with an 
experimental group. 


repeated measures 


Experiments in which an indi- 
vidual subject is exposed to more 
than one level of an experimental 
treatment. 
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test units 


The subjects or entities whose 
responses to the experimental 
treatment are measured or 
observed. 


Although experiments are often 
administered in groups, if all 
groups are not the same, then 
systematic error is introduced. 


systematic or 
nonsampling error 


Occurs if the sampling units in 
an experimental cell are some- 
how different than the units in 
another cell, and this difference 
affects the dependent variable. 


randomization 


The random assignment of sub- 
ject and treatments to groups; it 
is one device for equally distrib- 
uting the effects of extraneous 
variables to all conditions. 


nuisance variables 


Items that may affect the depen- 
dent measure but are not of 
primary interest. 


Part 3: Research Methods for Collecting Primary Data 


The introduction of the original Crystal Pepsi illustrates the need to think beyond consumers’ 
initial reactions. When Crystal Pepsi, a clear cola, was introduced, the initial trial rate was high, 
but only a small percentage of customers made repeat purchases. The brand never achieved high 
repeat sales within a sufficiently large market segment. Brand awareness, trial purchase, and repeat 
purchase are all possible dependent variables in an experiment. The dependent variable therefore 
should be considered carefully. Thorough problem definition will help the researcher select the 
most important dependent variable or variables. 


Selection and Assignment of Test Units 


Test units are the subjects or entities whose responses to the experimental treatment are measured 
or observed. Individual consumers, employees, organizational units, sales territories, market seg- 
ments, or other entities may be the test units. People, whether as customers or employees, are 
the most common test units in most organizational behavior, human resources, and marketing 
experiments. 


SAMPLE SELECTION AND RANDOM SAMPLING ERRORS 


As in other forms of business research, random sampling errors and sample selection errors may 
occur in experimentation. For example, experiments sometimes go awry even when a geographic 
area is specially chosen for a particular investigation. A case 
in point was the experimental testing of a new lubricant for 
outboard boat motors by Dow Chemical Company. The 
lubricant was tested in Florida. Florida was chosen because 
researchers thought the hot, muggy climate would provide 
the most demanding test. In Florida the lubricant was a suc- 
cess. However, the story was quite different when the prod- 
uct was sold in Michigan. Although the lubricant sold well 
and worked well during the summer, the following spring 
Dow discovered the oil had congealed, allowing the out- 
board motors, idle all winter, to rust. The rusting problem 
never came to light in Florida, where the motors were in 
year-round use. Thus, sample selection error occurs because 
of flaws in procedures used to assign experimental test 
units. Florida conditions made the experiment irrelevant in 
Michigan. 

Systematic or nonsampling error may occur if the sampling units in an experimental cell are 
somehow different than the units in another cell, and this difference affects the dependent variable. 
For example, suppose some professors are interested in testing the effect of providing snacks dur- 
ing exams on student’s scores. The experimental variable is snacks, manipulated over three levels: 
(1) fruit, (2) cookies, and (3) chocolate. The test units in this case are individual students. When the 
professors conduct the experiment, for convenience, they decide to give all of the 8:00 a.m. classes 
chocolate for a snack, all of the 1:00 p.m. classes get fruit, and all of the 7:00 p.m. classes get cookies. 
While this type of procedure is often followed, if our tastes and digestive systems react differently 
to different foods at different times of the day, systematic error is introduced into the experiment. 
Furthermore, because the night classes contain students who are older on average, the professors 
may reach the conclusion that students perform better when they eat cookies, when it may really 
be due to the fact that students who are older perform better no matter what they are fed. 
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RANDOMIZATION 


Randomization—the random assignment of subject and treatments to groups—is one device for 
equally distributing the effects of extraneous variables to all conditions. These nuisance variables, 
items that may affect the dependent measure but are not of primary interest, often cannot be 
eliminated. However, they will be controlled because they are likely to exist to the same degree 
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in every experimental cell if subjects are randomly assigned. In our self-efficacy experiment, it 
is likely that some subjects are happier with their positions to start with, have greater or lesser 
ability, and so forth. By randomly assigning employees to the control and experimental group, all 
these factors should balance out. Thus, all cells would be expected to yield similar average scores 
on the dependent variables if it were not for the experimental treatment administered. In other 
words, the researcher would like to set up a situation where everything in every cell is the same 
except for the experimental treatment. Random assignment of subjects allows the researcher to 
make this assumption. 


MATCHING 


Random assignment of subjects to the various experimental groups is the most common tech- 
nique used to prevent test units from differing from each other on key variables; it assumes that 
all characteristics of the subjects have been likewise randomized. Matching the respondents on the 
basis of pertinent background information is another technique for controlling systematic error by 
assigning subjects in a way that their characteristics are the same in each group. This is best thought 
of in terms of demographic characteristics. If a subject’s sex is expected to influence dependent 
variable responses, as in a taste test, then the researcher may make sure that there are equal num- 
bers of men and women in each experimental cell. In general, if a researcher believes that certain 
extraneous variables may affect the dependent variable, he or she can make sure that the subjects 
in each group are the same on these characteristics. 

For example, in an experiment examining three different training programs designed to 
develop leadership skills, it might be important to match the subjects on the basis of sex. That 
way, the same number of men and women will be exposed to Program A, Program B, and Pro- 
gram C. While matching can be a useful approach for a handful of key factors, the researcher can 
never be sure that sampling units are matched on all characteristics. Here, for example, perhaps the 
subjects in the leadership experiment need to be matched on education, intelligence, and work 
experience in addition to sex. It is easy to see the increasing complexity of trying to match the 
subjects on these four factors. However, even if this is accomplished, the researcher can still not 
know about other factors, such as interest in leadership, family influences, and various personality 
issues. As a result, random assignment is a more common approach to balancing subject charac- 
teristics than matching. 


CONTROL OVER EXTRANEOUS VARIABLES 


The fourth decision about the basic elements of an experiment concerns control over extraneous 
variables. This is related to the various types of experimental error. In an earlier chapter, we classi- 
fied total survey error into two basic categories: random sampling error and systematic error. The 
same dichotomy applies to all research designs, but the terms random (sampling) error and systematic 
error are more frequently used when discussing experiments. 


EXPERIMENTAL CONFOUNDS 


We have already discussed how systematic error can occur when the extraneous variables or 
the conditions of administering the experiment are allowed to influence the dependent vari- 
ables. When this occurs, the results will be confounded because the extraneous variables have 
not been controlled or eliminated. A confound means that there is an alternative explanation 
beyond the experimental variables for any observed differences in the dependent variable. Once 
a potential confound is identified, the validity of the experiment is severely questioned. 

Recall from the opening vignette the experimental procedures involved in the protocol test. 
The same data was sent over the two protocols in the experiment. What if the FIX protocol was 
better suited to handling small files, while the SOAP protocol was better suited for large files? If 
only small files were tested, the experiment has a confound. The size of the file is confounding the 
explanation that the FIX protocol is faster for sending financial data. In fact, it may depend on the 
size of the data file which protocol is faster. If large data sets had been used, the results may have 
indicated that SOAP was the faster protocol. 
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confound 


A confound means that there 

is an alternative explanation 
beyond the experimental vari- 
ables for any observed differ- 
ences in the dependent variable. 
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extraneous variables 


Variables that naturally exist in 
the environment that may have 
some systematic effect on 

the dependent variable. 
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In a simple experimental group—control group experiment, if subjects in the experimental 
group are always administered treatment in the morning and subjects in the control group 
always receive the treatment in the afternoon, a systematic error occurs. In such a situation, 
time of day represents a confound. In a training experiment the sources of constant error 
might be the persons who do the training (line or external specialists) or whether the training 
is conducted on the employees’ own time or on company time. These and other characteris- 
tics of the training may have an impact on the dependent variable and will have to be taken 
into account: 


The effect of a constant error is to distort the results in a particular direction, so that an erroneous difference 
masks the true state of affairs. The effect of a random error is not to distort the results in any particular 
direction, but to obscure them. Constant error is like a distorting mirror in a fun house; it produces a pic- 
ture that is clear but incorrect. Random error is like a mirror that has become cloudy with age; it produces 
a picture that is essentially correct but unclear.” 


EXTRANEOUS VARIABLES 


Most business students realize that the marketing mix variables—price, product, promotion, and 
distribution—interact with uncontrollable forces in the market, such as economic variables, com- 
petitor activities, and consumer trends. Thus, many marketing experiments are subject to the 
effect of extraneous variables. Since extraneous variables can produce confounded results, they 
must be identified before the experiment if at all possible. 

One issue with significant business and public policy implications is cigarette smoking. 
Does cigarette advertising cause young people to smoke? Although this is an often asked 
question, it is far from settled. One of the primary reasons for the inconclusiveness of this 
debate is the failure for most of the research to control for extraneous variables.° For instance, 
consider a study in which two groups of U.S. high school students are studied over the course 
of a year. One is exposed to foreign television media in which American cigarettes are more 
often shown in a flattering and glamorous light. In fact, the programming includes cigarette 
commercials. The other group is a control group in which their exposure to media is not 
controlled. At the end of the year, the experimental group reports a greater frequency and 
incidence of cigarette smoking. Did the increased media exposure involving cigarettes cause 
smoking behavior? 

While the result seems plausible at first, the careful researcher may ask the following 
questions: 


e Was the demographic makeup of the two groups the same? While it is clear that the ages of 
the two groups are likely the same, it is well known that different ethnic groups have different 
smoking rates. Approximately 28 percent of all high school students report smoking, but the 
rate is higher among Hispanic teens, for example.’ Therefore, if one group contained more 
Hispanics, we might expect it to report different smoking rates than otherwise. Similarly, 
smoking varies with social class. Were the two groups comprised of individuals from compa- 
rable social classes? 

e How did the control group fill the time consumed by the experimental group in being exposed 
to the experimental treatment? Could it be that it somehow dissuaded them from smoking? 
Perhaps they were exposed to media with more anti-smoking messages? 

e Were the two groups of the same general achievement profiles? Those who are high in the 
need for achievement may be less prone to smoke than are other students. 

e Although it is a difficult task to list all possible extraneous factors, some that even sound 
unusual can sometimes have an effect. For example, did the students have equally dispersed 
birthdays? Researchers have shown that smoking rates correspond to one’s birthday, meaning 
that different astrological groups have different smoking rates.* 


Because an experimenter does not want extraneous variables to affect the results, he or she must 
eliminate or control such variables. It is always better to spend time thinking about how to control 
for possible extraneous variables before the experiment, since often there is nothing that can be 
done to salvage results if a confounding effect is identified after the experiment is conducted. 
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Demand Characteristics 


What Are Demand Characteristics? 


The term demand characteristic refers to an experimental design element that unintentionally 
provides subjects with hints about the research hypothesis. Researchers cannot reveal the research 
hypotheses to subjects before the experiment or else they can create a confounding effect. Think 
about the self-efficacy experiment. If the subjects learned that they were being intentionally given 
positive feedback to enhance their confidence and attitudes toward their job, the researcher would 
never be sure if their responses to the dependent variable were really due to the differences in the 
experimental stimuli or due to the fact that the subjects were trying to provide a “correct” response. 
Once subjects know the hypotheses, there is little hope that they will respond naturally. 

A confound may be created by knowledge of the experimental hypothesis. This particular 
type of confound is known as a demand effect. Demand characteristics make demand effects 
very likely. 


Experimenter Bias and Demand Effects 


Demand characteristics are aspects of an experiment that demand (encourage) that the subjects respond 
in a particular way. Hence, they are a source of systematic error (see Exhibit 12.4 on the next page). 
If participants recognize the experimenter’s expectation or demand, they are likely to act in a manner 
consistent with the experimental treatment. Even slight nonverbal cues may influence their reactions. 
Prominent demand characteristics are often presented by the person administering experi- 
mental procedures. If an experimenter’s presence, actions, or comments influence the subjects’ 
behavior or sway the subjects to slant their answers to cooperate with the experimenter, the 
experiment has introduced experimenter bias. When subjects slant their answers to cooperate with 
the experimenter, they are exhibiting behaviors that might not represent their behavior in the 
marketplace. For example, if subjects in an advertising experiment understand that the experi- 
menter is interested in whether they changed their attitudes in accord with a given advertisement, 
they may answer in the desired direction. Acting in this manner reflects a demand effect rather 


than a true experimental treatment effect. 
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demand characteristic 


Experimental design element 
or procedure that unintention- 
ally provides subjects with hints 
about the research hypothesis. 


demand effect 


Occurs when demand character- 
istics actually affect the depen- 
dent variable. 


The experimenter 
unintentionally can create 
a demand effect by smiling, 
nodding, or frowning at the 
wrong time. 


268 


EXHIBIT 12.4 

By Smiling or Looking 
Solemn, Experimenters Can 
Modify Subject’s Behavior 


Hawthorne effect 


People will perform differently 
from normal when they know 
they are experimental subjects. 
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Hawthorne Effect 


A famous management experiment illustrates a common demand characteristic. Researchers were 
attempting to study the effects on productivity of various working conditions, such as hours of 
work, rest periods, lighting, and methods of pay, at the Western Electric Hawthorne plant in 
Cicero, Illinois. The researchers found that workers’ productivity increased whether the work 
hours were lengthened or shortened, whether lighting was very bright or very dim, and so on. 
The surprised investigators realized that the workers’ morale was higher because they were aware 
of being part of a special experimental group. This totally unintended effect is now known as the 
Hawthorne effect because researchers realize that people will perform differently when they know 
they are experimental subjects.” 

If subjects in a laboratory experiment interact (i.e., are not relatively isolated), their conversa- 
tions may produce joint decisions rather than a desired individual decision. For this reason, social 
interaction generally is restricted in laboratory experiments. 


Reducing Demand Characteristics 


Although it is practically impossible to eliminate demand characteristics from experiments, there 
are steps that can be taken to reduce them. Many of these steps make it difficult for subjects to 
know what the researcher is trying to find out. Some or all of these may be appropriate in a given 


experiment. 

1. Use an experimental disguise. 

2. Isolate experimental subjects. 

3. Use a “blind” experimental administrator. 

4. Administer only one experimental treatment level to each subject. 


EXPERIMENTAL DISGUISE 


Subjects participating in the experiment can be told that the purpose of the experiment is some- 
what different than the actual purpose. Most often, they are simply told less than the complete 
“truth” about what is going to happen. In other cases, more deceit may be needed. For example, 
psychologists studying how much pain one person may be willing to inflict on another might use 
a ruse telling the subject that they are actually interested in the effect of pain on human perfor- 
mance. The researcher tells the subject to administer a series of questions to another person (who 
is actually a research assistant) and to provide them with an increasingly strong electric shock each 
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time an incorrect answer is given. In reality, the real dependent variable has something to do with 
how long the actual subject will continue to administer shocks before stopping. 

A placebo is an experimental deception involving a false treatment. A placebo effect refers to 
the corresponding effect in a dependent variable that is due to the psychological impact that goes 
along with knowledge of the treatment. A placebo is particularly important when the experimen- 
tal variable involves physical consumption of some product. The placebo should not be different 
in any observable manner from the true treatment that is actually noticeable by the research sub- 
ject. Assume a researcher is examining the ability of a special food additive to suppress appetite. 
The additive is a product that is supposed to be sprinkled on food before it is eaten. The experi- 
mental group would be given the actual product to test, while the control group would be given 
a placebo that looks exactly like the actual food additive but is actually an inert compound. Both 
groups are likely to show some difference in consumption compared to someone undergoing no 
effect. The difference in the actual experimental group and the placebo group would represent 
the true effect of the additive. 

Placebo effects exist in marketing research. For example, when subjects are told that an energy 
drink is sold at a discount price, they believe it is significantly less effective than when it is sold at 
the regular, non-discounted price.'’ Later, we will return to the ethical issues involved in experi- 
mental deception. 


ISOLATE EXPERIMENTAL SUBJECTS 


Researchers should minimize the extent to which subjects are able to talk about the experimental 
procedures with each other. Although it may be unintentional, discussion among subjects may 
lead them to guess the experimental hypotheses. For instance, it could be that different subjects 
received different treatments, which the subjects could discover if they talked to one another. The 
experimental integrity will be higher when each subject only knows enough to participate in the 
experiment. 


USE A “BLIND” EXPERIMENTAL ADMINISTRATOR 


When possible, the people actually administering the experiment may not be told the experimen- 
tal hypotheses. The advantage is that if they do not know what exactly is being studied, then they 
are less likely to give off clues that result in demand effects. Like the subjects, when there is some 
reason to expect that their knowledge may constitute a demand characteristic, administrators best 
know only enough to do their job. 


ADMINISTER ONLY ONE EXPERIMENTAL 
CONDITION PER SUBJECT 


When subjects know more than one experimental treatment condition, they are much more likely 
to guess the experimental hypothesis. So, even though there are cost advantages to administering 
multiple treatment levels to the same subject, it should be avoided when possible. For example, 
in the self-efficacy experiment, if the subjects were asked to complete a questionnaire regarding 
their self-confidence in doing their job and their job satisfaction, then again asked to respond to 
the same questions after the personal interview, and then again after each of the three letters giving 
them positive feedback, they are very likely to guess that they are intentionally being given the 
feedback to enhance their self-efficacy. 


Establishing Control 


The major difference between experimental research and descriptive research is an experimenter’s 
ability to control variables by either holding conditions constant or manipulating the experimental 
variable. If the color of beer causes preference, a brewery experimenting with a new clear beer 
must determine the possible extraneous variables other than color that may affect an experi- 
ment’s results and attempt to eliminate or control those variables. Marketing theory tell us that 
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placebo 


A false experimental condition 
aimed at creating the impression 
of an effect. 


placebo effect 


The effect in a dependent vari- 
able associated with the psycho- 
logical impact that goes along 
with knowledge of some treat- 
ment being administered. 
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constancy of conditions 


Means that subjects in all experi- 
mental groups are exposed to 
identical conditions except 

for the differing experimental 
treatments. 


counterbalancing 


Attempts to eliminate the con- 
founding effects of order of pre- 
sentation by requiring that one- 

fourth of the subjects be exposed 
to treatment A first, one-fourth 

to treatment B first, one-fourth to 
treatment C first, and finally one- 

fourth to treatment D first. 
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brand image and packaging design are important factors in beer drinkers’ reactions. Therefore, 
the researcher may wish to control the influence of these variables. He or she may eliminate these 
two extraneous variables by packaging the test beers in plain brown packages without any brand 
identification. 

When extraneous variables cannot be eliminated, experimenters may strive for constancy of 
conditions. This means that subjects in all experimental groups are exposed to identical conditions 
except for the differing experimental treatments. Random assignment and the principle of match- 
ing discussed earlier help make sure that constancy is achieved. 

A supermarket experiment involving shelf space shows the care that must be taken to hold all 
factors constant. The experiment required that all factors other than shelf space be kept constant 
throughout the testing period. In all stores, the shelf level that had existed before the test began 
was to be maintained throughout the test period. Only the amount of shelf space (the treatment) 
was changed. One problem involved store personnel accidentally changing shelf level when stock- 
ing the test products. This deviation from the constancy of conditions was minimized by auditing 
each store four times a week. In this way, any change could be detected in a minimum amount of 
time. The experimenter personally stocked as many of the products as possible, and the coopera- 
tion of stock clerks also helped reduce treatment deviations. 

If an experimental method requires that the same subjects be exposed to two or more experi- 
mental treatments, an error may occur due to the order of presentation. For instance, if subjects are 
examining the effects of different levels of graphical interface on video game enjoyment, and 
they are asked to view each of four different levels, the order in which they are presented may 
influence enjoyment. Subjects might prefer one level simply because it follows a very poor level. 
Counterbalancing attempts to eliminate the confounding effects of order of presentation by requir- 
ing that one-fourth of the subjects be exposed to treatment A first, one-fourth to treatment B first, 
one-fourth to treatment C first, and finally one-fourth to treatment D first. Likewise, the other 
levels are counterbalanced so that the order of presentation is rotated among subjects. It is easy to 
see where counterbalancing is particularly important for experiments such as taste tests, where the 
order of presentation may have significant effects on consumer preference. 


Problems Controlling Extraneous Variables 


In many experiments it is not always possible to control every potential extraneous variable. 
For example, competitors may bring out a product during the course of a test-market. This 
form of competitive interference occurred in a Boston test-market for Anheuser-Busch’s import 
beer, Wurzburger Hofbrau. During the test, Miller Brewing Company introduced its own brand, 
Munich Oktoberfest, and sent eight salespeople out to blitz the Boston market. A competitor 
who learns of a test-market experiment may knowingly change its prices or increase advertising to 
confound the test results. This brings us to ethical issues in experimentation. 


Ethical Issues in Experimentation 


Ethical issues with business research were discussed in Chapter 5. There, the question of deception 
was raised. Although deception is necessary in most experiments, when subjects can be returned 
to their prior condition through debriefing, then the experiment is probably consistent with high 
moral standards. If subjects might be injured significantly or truly psychologically harmed, debrief- 
ing will not return them to their formal condition and the experiment should not be undertaken. 
Therefore, some additional commentary on debriefing is warranted. 

Debriefing experimental subjects by communicating the purpose of the experiment and the 
researcher’s hypotheses is expected to counteract negative effects of deception, relieve stress, and 
provide an educational experience for the subject. 


Proper debriefing allows the subject to save face by uncovering the truth for himself. The experimenter 
should begin by asking the subject if he has any questions or if he found any part of the experiment odd, 
confusing, or disturbing. This question provides a check on the subject’s suspiciousness and effectiveness of 
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manipulations. The experimenter continues to provide the subject cues to the deception until the subject 
states that he believes there was more to the experiment than met the eye. At this time the purpose and 
procedure of the experiment [are] revealed." 


Additionally, there is the issue of test-markets and efforts extended toward interfering with a 
competitor’s test-market. The Research Snapshot dealing with Hidden Valley Ranch salad dress- 
ings on page 273 describes just such a situation. When a company puts a product out for public 
consumption, they should be aware that competitors may also now freely consume the product. 
When attempts to interfere with a test-market are aimed solely at invalidating test results or they 
are aimed at infringing on some copyright protection, those acts are ethically questionable. 


Practical Experimental Design Issues 


Basic versus Factorial Experimental Designs 


In basic experimental designs a single independent variable is manipulated to observe its effect on 
a single dependent variable. Our example of the computer communication protocols falls into 
this category—one independent variable (the two protocols) was examined and one dependent 
measure (speed of the data transfer) was assessed. However, we know that most business situations 
are much more complex and multiple independent and dependent variables are possible. Our self- 
efficacy experiment illustrated this as both the treatment and the length of time as an employee 
were independent variables and multiple dependent variables were examined. In a complex mar- 
keting experiment, multiple dependent variables such as sales, product usage, and preference are 
influenced by several factors. The simultaneous change in independent variables such as price and 
advertising may have a greater influence on sales than if either variable is changed alone. In job 
satisfaction studies, we know that no one thing totally determines job satisfaction. Salary, opportu- 
nities for advancement, the pleasantness of the workplace, interactions with colleagues, and many 
more factors all combine and interact to determine how satisfied employees are with their job. 
Factorial experimental designs are more sophisticated than basic experimental designs and allow for 
an investigation of the interaction of two or more independent variables. 


Laboratory Experiments 


A business experiment can be conducted in a natural setting (a field experiment) or in an artificial 
setting (a laboratory experiment). In social sciences, the actual laboratory may be a behavioral lab, 
which is somewhat like a focus group facility. However, it may simply be a room or classroom 
dedicated to collecting data, or it can even take place in one’s home. 

In a laboratory experiment the researcher has more complete control over the research setting 
and extraneous variables. Our example of the financial protocol experiment illustrates the benefits 
of a laboratory setting. The researchers were able to control for many factors, such as the size of 
the data file, the models of the computers, the Internet line, and so forth. This enhanced their 
confidence in establishing that the differences noted in speed were due to the different protocols. 
However, the researchers were not able to determine how the protocols compared when used 
in the field, on various computers, with a variety of file sizes, and under differing “real-world” 
circumstances. 

In testing the effectiveness of a television commercial, subjects can be recruited and brought 
to an advertising agency’s office, a research agency’s office, or perhaps a mobile unit designed for 
research purposes. They are exposed to a television commercial within the context of a program 
that includes competitors’ ads among the commercials shown. As compensation for their time, they 
are then allowed to purchase either the advertised product or one of several competing products 
in a simulated store environment. Trial purchase measures are thus obtained. A few weeks later, 
subjects are contacted again to measure their satisfaction and determine repeat purchasing intention. 
This laboratory experiment gives the consumer an opportunity to “buy” and “invest.” In a short 


271 


laboratory experiment 


The researcher has more com- 
plete control over the research 
setting and extraneous variables. 
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Facilities like this one can break 
down the food that companies 
sell and tell them exactly what 
it should taste like. Is this a 
good way to test the taste of 
new products? 


tachistoscope 


Device that controls the amount 
of time a subject is exposed to a 
visual image. 


field experiments 


Research projects involving 
experimental manipulations that 
are implemented in a natural 
environment. 


The naturally occurring noise 
that exists in the field can 
interfere with experimental 
manipulations. 
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time span, the marketer is able to collect information on decision making. In 
this example, many of the outside influences can be controlled. 

Other laboratory experiments may be more controlled or artificial. For 
example, a tachistoscope allows a researcher to experiment with the visual 
impact of advertising, packaging, and so on by controlling the amount of 
time a subject is exposed to a visual image. Each stimulus (for example, pack- 
age design) is projected from a slide to the tachistoscope at varying exposure 
lengths (1/10 ofa second, 2/10, 3/10, and so on). The tachistoscope simulates 
the split-second duration of a customer’s attention to a package in a mass 
display. 


Field Experiments 


Field experiments are research projects involving experimental manipulations that are implemented 
in a natural environment. They can be useful in fine-tuning managerial strategies and tactical deci- 
sions. Our self-efficacy study is an example of a field experiment. Rather than bring subjects into 
an artificial setting and trying to manipulate their self-efficacy and then measure their perceptions of 
job satisfaction, the researchers took their experiment to the field and used actual employees, which 
were provided feedback from their supervisors. In the marketing discipline, test-markets are good 
examples of field experiments. Betty Crocker’s Squeezit (a 10 percent fruit juice drink in a squeeze 
bottle) was so successful in a test-market that production could not keep up with demand. As a result, 
the product’s national introduction was postponed until production capacity could be increased. 

McDonald’s conducted a field experiment testing the Triple Ripple, a three-flavor ice cream 
product. The product was dropped because the experiment revealed distribution problems reduced 
product quality and limited customer acceptance. In the distribution system the product would 
freeze, defrost, and refreeze. Solving the problem would have required each McDonald’s city to 
have a local ice cream plant with special equipment to roll the three flavors into one. While a labo- 
ratory experiment might have shown tremendous interest, a naturalistic setting for the experiment 
helped McDonald’s executives realize the product was impractical. 

Experiments vary in their degree of artificiality and control. Exhibit 12.5 shows that as experi- 
ments increase in naturalism, they 
begin to approach a pure field 
experiment. As they become more 
artificial, they approach a pure lab- 
oratory experiment. 

In field experiments, a re- 
searcher manipulates experimental 
variables but cannot possibly con- 
trol all the extraneous variables. 
An example is NBC’s research on 
new television programs. Viewers 
who subscribe to a cable television 
service are asked to watch a cable 
preview on their home television 
sets at a certain time on a certain 
cable channel. While the program 
is being aired, telephone calls from 
the viewers’ friends cannot be con- 
trolled. In contrast, an advertising 
professor may test some advertising 
effect by showing subjects adver- 
tising in a classroom setting. Here, 
there are no phone calls and little 
to distract the subject. Which pro- 
duces a better experiment? 


A The Hidden in Hidden 
~ Valley Ranch 
A few years ago, Hidden Valley Ranch 
(HVR) conducted a field market experiment to 
examine how effective three new flavors of salad 
dressings would be in the marketplace. Thus, there were three 
levels of the experimental variable, each representing a dif- 
ferent flavor. Tests like this can be costly. HVR had to produce 
small batches of each flavor, get them bottled, and ship them 
to their sales representatives, who then had to stock the 
dressings in the participating retail stores. All of this is very 
expensive. 
The first day of the test was consumed with sales reps 


flavor a huge success? Actually, one of HVR’s competitors had 
noticed the test and sent its sales reps around beginning on 
the second day to buy every bottle of the new HVR dressings 
in every store it had been placed in. Thus, HVR was unable to 
produce any valid sales data (the dependent variable) and the 
competitor was able to break down the dressing in its labs and 
determine the recipe. 

This illustrates one risk that comes along with field tests. 
Once a product is available for sale, there are no secrets. Also, 
you risk espionage 
of this type that can 
render the experi- 
ment invalid. 


placing the products in the salad dressing sections of retail 

stores. The second day, each rep went back to each store to 
record the number of sales for each flavor. By the third day, 
all of the bottles of all flavors had sold! Amazing! Was every 
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The Artificiality of 
Laboratory versus Field 
Experiments 


Laboratory 
experiments 


Field 
experiments 


Generally, subjects know when they are participating in a laboratory experiment. Performance 
of certain tasks, responses to questions, or some other form of active involvement is characteristic of 
laboratory experiments. In field experiments, such as test-markets or the self-efficacy experiment, 
subjects do not even know they are taking part in an experiment. Ethically, consent should be sought 
before having someone participate in an experiment. However, with field experiments the consent is 
implied since subjects are not asked to do anything departing from their normal behavior to participate 
in the experiment. All precautions with respect to safety and confidentiality should be maintained. 

Field experiments involving new products or promotions are often conducted in a retail store. 
These are known as controlled store tests. The products are put into stores in a number of small cities 
or into selected supermarket chains. Product deliveries are made not through the traditional warehouse 
but by the research agency, so product information remains confidential. The Research Snapshot 
above describes such a test. While they can be less expensive than a full-blown market test, they also 
have drawbacks because of the relatively small sample of stores and the limitations on the type of outlet 
where the product is tested. Thus, their results may not generalize to all consumers in a population. 


Within-Subjects and Between-Subjects Designs 


A basic question faced by the researchers involves how many treatments a subject should receive. 


For economical reasons, the researcher may wish to apply multiple treatments to the same subject. within-subjects design 


Thus, multiple observations on the dependent variable can be obtained from a single subject. Involves repeated measures 


because with each treatment the 
same subject is measured. 


Such a design is called a within-subjects design. Within-subjects designs involve repeated measures 
because with each treatment the same subject is measured. 
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between-subjects design In contrast, the researcher could decide that each person will receive only one treatment 
Each subject receives only one Combination. This is referred to as a between-subjects design. Each dependent variable is measured 
treatment combination. only once for every subject. Exhibit 12.6 illustrates this point. 


EXHIBIT 12.6 
Within- and Between- 
Subjects Designs 


Ta 
N 


Between-subjects designs are usually advantageous even though they are typically more costly. 
The validity of between-subjects designs is usually higher since applying only one treatment com- 
bination to each subject greatly reduces the possibility of demand characteristics. In addition, as 
we will see later, statistical analysis of between-subjects designs are simpler than within-subjects 
designs. This also means the results are easier to report and explain to management. 


Issues of Experimental Validity 


An experiment’s quality is judged by two types of validity. These are known as internal and exter- 
nal validity. 


internal validity Internal Validity 


Exists to the extent that an 


experimental variable is truly j ; , : Í 
responsible for any variancein ance in the dependent variable. In other words, does the experimental manipulation truly cause 


the dependent variable. changes in the specific outcome of interest? If the observed results were influenced or confounded 


Internal validity exists to the extent that an experimental variable is truly responsible for any vari- 
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by extraneous factors, the researcher will have problems making valid conclusions about the rela- 
tionship between the experimental treatment and the dependent variable. 

Thus, a lab experiment enhances internal validity because it maximizes control of outside 
forces. If we wish to know whether certain music causes increased productivity among workers, 
we may set up a task in a room with different music piped in (our experimental manipulation), but 
with the temperature, lighting, density, other sounds, and any other factors all controlled, which 
would be difficult or impossible to control outside of a lab environment. If the only thing that var- 
ies from subject to subject is the music, then we can safely say that any differences in performance 
must be attributable to human reactions to the music. Our opening example of the protocol 
experiment focused on maximizing internal validity. By testing the protocols in a lab setting, the 
researchers were able to control extraneous variables such as differences in computing hardware, 
network issues, and so forth. 


MANIPULATION CHECKS 


Internal validity depends in large part on successful manipulations. Manipulations should be car- 
ried out in a way that the independent variable differs over meaningful levels. If the levels are too 
close together, the experiment may lack the power necessary to observe differences in the depen- 
dent variable. In a pricing experiment, it may be that manipulating the price of an automobile 
over two levels, $24,600 and $24,800, would not be successful in creating truly different price 
categories. Respondents might not perceive the differences or experience any reaction to such a 
slight deviation. 

The validity of manipulations can often be determined with a manipulation check. If a drug is 
administered in different dosages that should affect blood sugar levels, the researcher could actually 
measure blood sugar level after administering the drug to make sure that the dosages were differ- 
ent enough to produce a change in blood sugar. In business research, the manipulation check is 
often conducted by asking a survey question or two. In the pricing example above, subjects may 
be asked a question about how low they believe the price of the car to be. A valid manipulation 
would produce substantially different average responses to that question in a “high” and “low” 
price group. In our self-efficacy example, the researchers were interested in the impact increased 
self-efficacy (the independent variables) had on job satisfaction (the dependent variable). The 
experimental manipulation was the positive feedback the subjects were given. The manipulation 
check was a series of questions assessing the subject’s self-efficacy. Did the positive feedback actu- 
ally increase self-efficacy? If it did, then the researchers could examine the other relationships of 
interest. However, if self-efficacy did not increase, then the researchers would have to reconsider 
their manipulation and find another way to enhance self-efficacy to carry out the study. Manipu- 
lation checks should always be administered after dependent variables in self-response format 
experiments. This keeps the manipulation check item from becoming a troublesome demand 
characteristic. 

Extraneous variables can jeopardize internal validity. The six major ones are history, maturation, 
testing, instrumentation, selection, and mortality. 


HISTORY 


A history effect occurs when some change other than the experimental treatment occurs dur- 
ing the course of an experiment that affects the dependent variable. A common history effect 
occurs when competitors change their marketing strategies during a test marketing experiment. 
Another example would be if some of our subjects in the self-efficacy exam are offered a position 
by another firm. A different job offer may affect several of the dependent measures in the study. 
History effects are particularly prevalent in repeated measures experiments that take place over an 
extended time. If we wanted to assess how much a change in recipe improves individual subjects’ 
consumption of a food product, we would first measure their consumption and then compare it 
with consumption after the change. Since several weeks may pass between the first and second 
measurement, there are many things that could occur that would also influence subjects’ diets. 
Although it would be extreme, examining the effect of a dietary supplement on various 
health-related outcomes may require that a subject be confined during the experiment’s course. 
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manipulation check 


A validity test of an experimental 
manipulation to make sure that 
the manipulation does produce 
differences in the independent 
variable. 


history effect 


Occurs when some change other 
than the experimental treat- 
ment occurs during the course 
of an experiment that affects the 
dependent variable. 
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cohort effect 


Refers to a change in the depen- 
dent variable that occurs because 
members of one experimental 
group experienced different his- 
torical situations than members 
of other experimental groups. 


maturation effects 


Effects that are a function of 
time and the naturally occurring 
events that coincide with growth 
and experience. 


testing effects 


A nuisance effect occurring when 
the initial measurement or test 
alerts or primes subjects in a way 
that affects their response to the 
experimental treatments. 


instrumentation effect 


A nuisance that occurs when a 
change in the wording of ques- 
tions, a change in interviewers, 
or a change in other procedures 
causes a change in the depen- 
dent variable. 
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This may take several weeks. Without confining the subject in something like a hospital setting, 
there would be little way of controlling food and drink consumption, exercise activities, and other 
factors that may also affect the dependent variables. 

A special case of the history effect is the cohort effect, which refers to a change in the 
dependent variable that occurs because members of one experimental group experienced dif- 
ferent historical situations than members of other experimental groups. For example, groups 
of managers used as subjects may be in different cohorts because one group encountered dif- 
ferent experiences over the course of an experiment. Let’s assume the experimental manip- 
ulation involves different levels of financial incentives and performance is the dependent 
variable. The experiment is being conducted in waves; as the managers come to the home 
office for training they are told about the financial incentives that are being implemented. 
During this period, however, a financial crisis occurs. Since the first group participated prior 
to this development, they would not be affected by it. However, subsequent groups might 
have different attitudes and increased performance due to the environmental change. The 
possibility exists that the financial crisis rather than the change in incentive is truly causing 
differences in performance. 


MATURATION 


Maturation effects are effects that are a function of time and the naturally occurring events that 
coincide with growth and experience. Experiments taking place over longer time spans may see 
lower internal validity as subjects simply grow older or more experienced. For example, our 
self-efficacy study shows that job satisfaction seems to decline with time (note in Figure 12.2 
that the control group subjects that are new employees report a mean of 5.80 while the current 
employees mean is 4.77). Conversely, job skill tends to increase over time. Suppose an experi- 
ment were designed to test the impact of a new compensation program on sales productivity. If 
this program were tested over a year’s time, some of the salespeople probably would mature as 
a result of more selling experience and gain increased knowledge and skill. Their sales produc- 
tivity might improve because of their knowledge and experience rather than the compensation 
program. 


TESTING 


Testing effects are also called pretesting effects because the initial measurement or test alerts or 
primes subjects in a way that affects their response to the experimental treatments. Testing 
effects only occur in a before-and-after study. A before-and-after study is one requiring an 
initial baseline measure be taken before an experimental treatment is administered. So, before- 
and-after experiments are a special case of a repeated measures design. For example, students 
taking standardized achievement and intelligence tests for the second time usually do better 
than those taking the tests for the first time. The effect of testing may increase awareness of 
socially appropriate answers, increase attention to experimental conditions (that is, the subject 
may watch more closely), or make the subject more conscious than usual of the dimensions 
of a problem. 


INSTRUMENTATION 


A change in the wording of questions, a change in interviewers, or a change in other procedures 
used to measure the dependent variable causes an instrumentation effect, which may jeopardize 
internal validity. Sometimes instrumentation effects are difficult to control. For example, if the 
same interviewers are used to ask questions for both before and after measurement, some prob- 
lems may arise. With practice, interviewers may acquire increased skill in interviewing, or they 
may become bored and decide to reword the questionnaire in their own terms. To avoid this 
problem, new interviewers could be hired. But this introduces another set of issues as different 
individuals are also a source of extraneous variation. There are numerous other sources of instru- 
ment decay or variation. Again, instrumentation effects are problematic with any type of repeated 
measures design. 


Chapter 12: Experimental Research 


SELECTION 


The selection effect is a sample bias that results from differential selection of respondents for 
the comparison groups, or sample selection error, discussed earlier. Researchers must make 
sure the characteristics of the research subjects accurately reflect the population of relevance. 
Furthermore, the key characteristics of the subjects must be distributed in such a way to cre- 
ate equal groups. That is, the subjects in the experimental and control groups, or in different 
experimental cells, must be equal across all variables of interest and those that could affect the 
dependent measure. 


MORTALITY 


If an experiment is conducted over a period of a few weeks or more, some sample bias may 
occur due to the mortality effect (sample attrition). Sample attrition occurs when some subjects 
withdraw from the experiment before it is completed. Mortality effects may occur if subjects 
drop from one experimental treatment group disproportionately than from other groups. Con- 
sider a sales training experiment investigating the effects of close supervision of salespeople (high 
pressure) versus low supervision (low pressure). The high-pressure condition may misleadingly 
appear superior if those subjects who completed the experiment did very well. If, however, the 
high-pressure condition caused more subjects to drop out than the other conditions, this apparent 
superiority may be due to the fact that only very determined and/or talented salespeople stuck 
with the program. Similarly, in the self-efficacy study, accountants that did not feel commitment 
to the organization and maintain a high level of job satisfaction may have left the organization 
before the final measures. 


External Validity 


External validity is the accuracy with which experimental results can be generalized beyond the 
experimental subjects. External validity is increased when the subjects comprising the sample truly 
represent the population of interest and when the results extend to other market segments or 
groups of people. The higher the external validity, the more researchers and managers can count 
on the fact that any results observed in an experiment will also be seen in the “real world” (finan- 
cial market, workplace, sales floor, and so on). 

For instance, to what extent would results from our protocol experiment, which represents 
a simulated financial market data exchange, transfer to a real-world trading situation? Would the 
FIX protocol prove to be faster across computer systems, Internet line transfer speeds, and differ- 
ent traders? Would increases in self-efficacy enhance the job satisfaction of retail store workers, 
salespeople, or human resource managers as it did for accountants? Can one extrapolate the results 
from a tachistoscope to an in-store shopping situation? Lab experiments, such as the protocol 
experiment, are associated with low external validity because the limited set of experimental 
conditions, holding all else constant, do not adequately represent all the influences existing in the 
real world. In other words, the experimental situation may be too artificial. When a study lacks 
external validity, the researcher will have difficulty repeating the experiment with any change in 
subjects, settings, or time. 


STUDENT SUBJECTS 


Basic researchers often use college students as experimental subjects.!? Convenience, time, money, 
and a host of other practical considerations often result in students being used as research subjects. 
This practice is widespread in academic studies. Some evidence shows that students are quite 
similar to household consumers, but other evidence indicates that they do not provide sufficient 
external validity to represent most consumer or employee groups. This is particularly true when 
students are used as substitutes or surrogates for businesspeople. 

The issue of external validity should be seriously considered because the student popula- 
tion is likely to be atypical. Students are easily accessible, but they often are not representative of 
the total population. This is not always the case, however, and when behaviors are studied for 
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selection effect 


Sample bias from differential 
selection of respondents for 
experimental groups. 


mortality effect (sample 
attrition) 


Occurs when some subjects 
withdraw from the experiment 
before it is completed. 


external validity 


Is the accuracy with which 
experimental results can be gen- 
eralized beyond the experimental 
subjects. 
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basic experimental design 


An experimental design in which 
only one variable is manipulated. 


quasi-experimental 
designs 


Experimental designs that do not 
involve random allocation of sub- 
jects to treatment combinations. 
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which students have some particular expertise (the purchase of relevant products such as MP3 
players or job search skills), then they are certainly appropriate. For instance, the Research Snap- 
shot “Does Promotion Cause Intoxication?” on page 262 is an example where students are very 
appropriate research subjects. 


Trade-Offs Between Internal and External Validity 


Naturalistic field experiments tend to have greater external validity than artificial laboratory exper- 
iments. Researchers often must trade internal validity for external validity. A researcher who 
wishes to test advertising effectiveness by manipulating treatments via a split-cable experiment 
has the assurance that the advertisement will be viewed in an externally valid situation, the sub- 
jects’ homes. However, the researcher has no assurance that some interruption (for example, the 
telephone ringing, a child calling, or a pot boiling over on the stove) will not have some influ- 
ence that will reduce the internal validity of the experiment. Laboratory experiments with many 
controlled factors usually are high in internal validity, while field experiments generally have less 
internal validity but greater external validity. Typically, it is best to establish internal validity first, 
and then focus on external validity. Thus, results from lab experiments would be followed up with 
some type of field test. 


Classification of Experimental Designs 


An experimental design may be compared to an architect’s plans for a building. The basic require- 
ments for the structure are given to the architect by the prospective owner. Several different plans 
may be drawn up as options for meeting the basic requirements. Some may be more costly than 
others. One may offer potential advantages that another does not. 

There are various types of experimental designs. If only one variable is manipulated, the 
experiment has a basic experimental design. If the experimenter wishes to investigate several levels 
of the independent variable (for example, four different employee salary levels) or to investigate 
the interaction effects of two or more independent variables (salary level and retirement package), 
the experiment requires a complex, or statistical, experimental design. 


Symbolism for Diagramming Experimental Designs 


The work of Campbell and Stanley has helped many students master the subject of basic exper- 
imental designs. The following symbols will be used in describing the various experimental 
designs: 


X = exposure of a group to an experimental treatment 


O = observation or measurement of the dependent variable; if more than one observation or measure- 
ment is taken, subscripts (that is, O,, O,, etc.) indicate temporal order 


R = random assignment of test units; R symbolizes that individuals selected as subjects for the experi- 
ment are randomly assigned to the experimental groups 


The diagrams of experimental designs that follow assume a time flow from left to right. Our 
first example will make this clearer. 


Three Examples of Quasi-Experimental Designs 


Quasi-experimental designs do not involve random allocation of subjects to treatment combina- 
tions. In this sense, they do not qualify as true experimental designs because they do not ade- 
quately control for the problems associated with loss of internal validity. However, sometimes 
quasi-experimental designs are the only way to implement a study. 
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ONE-SHOT DESIGN 


The one-shot design, or after-only design, is diagrammed as follows: 
X O, 


Suppose that during a very cold winter an automobile dealer finds herself with a large inven- 
tory of cars. She decides to experiment for the month of January with a promotional scheme. 
She offers a free trip to New Orleans with every car sold. She experiments with the promotion (X = 
experimental treatment) and measures sales (O,= measurement of sales after the treatment is 
administered). 

This one-shot design is a case study of a research project fraught with problems. Subjects or 
test units participate because of voluntary self-selection or arbitrary assignment, not because of 
random assignment. The study lacks any kind of comparison or any means of controlling extrane- 
ous influences. There should be a measure of what will happen when the test units have not been 
exposed to X to compare with the measures of when subjects have been exposed to X. The one- 
shot experimental design commonly suffers from most of the threats to internal validity discussed 
above. Nevertheless, under certain circumstances, it is the only viable choice. 


ONE-GROUP PRETEST-POSTTEST DESIGN 


Suppose a real estate franchiser wishes to provide a training program for franchisees. If the fran- 
chiser measures subjects’ knowledge of real estate selling before (O,) they are exposed to the 
experimental treatment (X) and then measures real estate selling knowledge after (O,) they are 
exposed to the treatment, the design will be as follows: 


Oo 2. 0) 


In this example the trainer is likely to conclude that the difference between O, and O, (O, — O.) 
is the measure of the influence of the experimental treatment. This one-group pretest—posttest 
design offers a comparison of the same individuals before and after training. Although this is an 
improvement over the one-shot design, this research still has several weaknesses that may jeop- 
ardize internal validity. For example, if the time lapse between O, and O, was a period of several 
months, the trainees may have matured as a result of experience on the job (maturation effect). 
History effects—such as a change in interest rates—may also influence the dependent measure in 
this design. Perhaps some subjects dropped out of the training program (mortality effect). The 
effect of testing may also have confounded the experiment. 

Although this design has a number of weaknesses, it is commonly used in business research. 
Remember, the cost of the research is a consideration in most business situations. While there will 
be some problems of internal validity, the researcher must always take into account questions of 
time and cost. 


STATIC GROUP DESIGN 


In a static group design, each subject is identified as a member of either an experimental group or 
a control group (for example, exposed or not exposed to a training program). The experimental 
group is measured after being exposed to an experimental treatment and the control group is mea- 
sured without having been exposed to this experimental treatment: 


Experimental group: X O 
Control group: O 


2 


1 


The results of the static group design are computed by subtracting the observed results in the 
control group from those in the experimental group (O, — O,). A major weakness of this design 
is its lack of assurance that the groups were equal on variables of interest before the experimen- 
tal group received the treatment. If entry into either group was voluntary, systematic differ- 
ences between the groups could invalidate the conclusions about the effect of the treatment. For 
example, if the real estate franchisor mentioned above asked her franchisees who would like to 
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attend the training program, we have no way of knowing if those who chose to attend are the 
same as those who did not. Random assignment of subjects may eliminate problems with group 
differences. If groups are established by the experimenter rather than existing as a function of some 
other causation, the static group design is referred to as an after-only design with control group. 

On many occasions, an after-only design is the only possible option. This is particularly true 
when conducting use tests for new products or brands. Cautious interpretation and recognition of 
the design’s shortcomings may enhance the value of this design. 


Three Alternative Experimental Designs 


In a formal scientific sense, the three designs just discussed are not pure experimental designs. 
Subjects for the experiments were not selected from a common pool of subjects and randomly 
assigned to one group or another. In the following discussion of three basic experimental designs, 
the symbol to the left of the diagram indicates that the first step in a true experimental design is 
the random assignment of subjects. 


PRETEST-POSTTEST CONTROL GROUP DESIGN 
(BEFORE-AFTER WITH CONTROL) 


A pretest—posttest control group design, or before—after with control group design, is the classic experi- 
mental design: 
O X O, 


O O 


3 4 


Experimental group: 


BE 


Control group: 


As the diagram indicates, the subjects in the experimental group are tested before and after 
being exposed to the treatment. The control group is tested at the same two times as the experi- 
mental group, but subjects are not exposed to the experimental treatment. This design has the 
advantages of the before—after design with the additional advantages gained by its having a control 
group. The effect of the experimental treatment equals: 


(0, — O,) = (0, - 5) 


It is important to note that we expect O, = O,. One of the threats we discussed to internal 
validity was selection and the assumption of equal groups. If the two groups are not equal at 
the beginning of the experiment, the study has a fatal flaw and the researchers should start over. 
Let’s assume there is brand awareness among 20 percent of the subjects (O, = 20 percent, O, = 
20 percent) before an advertising treatment and then 35 percent awareness in the experimental 
group (O, = 35 percent) and 22 percent awareness in the control group (O, = 22 percent) after 
exposure to the treatment, the treatment effect equals 13 percent: 


(0.35 — 0.20) — (0.22 — 0.20) = (0.15) = (0.02) = 0.13 or 13% 


Not only are the groups assumed to be equal at the beginning, but the effect of all extraneous 
variables is assumed to be the same on both the experimental and the control groups. For instance, 
since both groups receive the pretest, no difference between them is expected for the pretest 
effect. This assumption is also made for effects of other events between the before and after mea- 
surements (history), changes within the subjects that occur with the passage of time (maturation), 
testing effects, and instrumentation effects. In reality there may be some differences in the sources 
of extraneous variation. Nevertheless, in most cases assuming that the effect is approximately equal 
for both groups is reasonable. 

However, a testing effect is possible when subjects are sensitized to the subject of the research. 
This is analogous to what occurs when people learn a new vocabulary word. Soon they discover 
that they notice it much more frequently in their reading. In an experiment the combination of 
being interviewed on a subject and receiving the experimental treatment might be a potential 
source of error. For example, a subject exposed to a certain advertising message in a split-cable 
experiment might say, “Ah, there is an ad about the product I was interviewed about yesterday!” 
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The subject may pay more attention than normal to the advertisement and be more prone to 
change his or her attitude than in a situation with no interactive testing effects. This weakness in 
the before—after with control group design can be corrected (see the next two designs). 

Testing the effectiveness of television commercials in movie theaters provides an example of 
the before—after with control group design. Subjects are selected for the experiments by being told 
that they are going to preview several new television shows. When they enter the theater, they 
learn that a drawing for several types of products will be held, and they are asked to complete a 
product preference questionnaire (see Exhibit 12.7). Then a first drawing is held. Next, the televi- 
sion pilots and commercials are shown. Then the emcee announces additional prizes and a second 
drawing. Finally, subjects fill out the same questionnaire about prizes. The information from the 
first questionnaire is the before measurement, and that from the second questionnaire is the after 
measurement. The control group receives similar treatment except that on the day they view the 
pilot television shows, different (or no) television commercials are substituted for the experimental 
commercials. 


T 12.7 Product Preference Measure in an Experiment 


We are going to give away a series of prizes. If you are selected as one of the winners, which brand from each of the groups listed below 


would you truly want to win? 
Special arrangements will be made for any product for which bulk, or one-time, delivery is not appropriate. 
Indicate your answers by filling in the box like this: E 


Do not “X,” check, or circle the boxes please. 


Cookies Allergy Relief Products 

(A 3-month supply, pick ONE.) (A year’s supply, pick ONE.) 

NABISCO OREO (1) ALLEREST (1) 
NABISCO OREO DOUBLE STUFF (2) BENADRYL (2) 
NABISCO NUTTER BUTTER (3) CONTAC (3) 
NABISCO VANILLA CREMES (4) TAVIST-D (4) 
HYDROX CHOCOLATE (5) DRISTAN (5) 
HYDROX DOUBLES (6) SUDAFED (6) 
NABISCO COOKIE BREAK (7) CHLOR-TRIMETON (7) 
NABISCO CHIPS AHOY (8) 

KEEBLER E.L. FUDGE (9) 

KEEBLER FUDGE CREMES (10) 

KEEBLER FRENCH VANILLA CREMES (11) 


POSTTEST-ONLY CONTROL GROUP DESIGN 
(AFTER-ONLY WITH CONTROL) 


In some situations pretest measurements are impossible. In other situations selection error is not 
anticipated to be a problem because the groups are known to be equal. The posttest-only control 
group design, or after-only with control group design, is diagrammed as follows: 


Experimental group: R X O 
Control group: IRJ O 


N 


The effect of the experimental treatment is equal to O, — O,. 

Suppose the manufacturer of an athlete’s-foot remedy wishes to demonstrate by experimen- 
tation that its product is better than a competing brand. No pretest measure about the effec- 
tiveness of the remedy is possible. The design is to randomly select subjects, perhaps students, 
who have contracted athlete’s foot and randomly assign them to the experimental or the con- 
trol group. With only the posttest measurement, the effects of testing and instrument variation 
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time series design 


Used for an experiment inves- 
tigating long-term structural 
changes. 
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are eliminated. Furthermore, researchers make the same assumptions about extraneous variables 
described above—that is, that they operate equally on both groups, as in the before—after with 
control group design. 


COMPROMISE DESIGNS 


True experimentation is often simply not possible. The researcher may compromise by approxi- 
mating an experimental design. A compromise design is one that falls short of assigning subjects or 
treatments randomly to experimental groups. 

Consider a situation in which a researcher would ideally implement a pretest—posttest control 
group design to study the effect of training on employee performance. In this case, subjects may 
not be able to be assigned randomly to the experimental and control group because the researcher 
cannot take workers away from their work groups. Thus, one entire work group is used as the 
experimental group and a separate work group is used as a control group. The researcher has no 
assurance that the groups are equivalent. The situation has forced a compromise to experimental 
integrity. 

The alternative to the compromise design when random assignment of subjects is not pos- 
sible is to conduct the experiment without a control group. Generally this is considered a greater 
weakness than using groups that have already been established. When the experiment involves a 
longitudinal study, circumstances usually dictate a compromise with true experimentation. 


Time Series Designs 


Many experiments may be conducted in a short period of time (a few hours, a week, or a month). 
However, a business experiment investigating long-term strategic and/or structural changes may 
require a time series design. Time series designs are quasi-experimental because they generally 
do not allow the researcher full control over the treatment exposure or influence of extraneous 
variables. When experiments are conducted over long periods of time, they are most vulnerable to 
history effects due to changes in population, attitudes, economic patterns, and the like. Although 
seasonal patterns and other exogenous influences may be noted, the experimenter can do little 
about them when time is a major factor in the design. 

Political tracking polls provide an example. A pollster normally uses a series of surveys to 
track candidates’ popularity. Consider the candidate who plans a major speech (the experimental 
treatment) to refocus the political campaign. The simple time series design can be diagrammed as 
follows: 


O O 


1 2 6 


Oo, X 0 O, 0 

Several observations have been taken to identify trends before the speech (X) is given. After the 
treatment has been administered, several observations are made to determine if the patterns after the 
treatment are similar to those before. If the longitudinal pattern shifts after the political speech, the 
researcher may conclude that the treatment had a positive impact on the pattern. Of course, this time 
series design cannot give the researcher complete assurance that the treatment caused the change in 
the trend, rather than some external event. Problems of internal validity are greater than in more 
tightly controlled before-and-after designs for experiments of shorter duration. 

One unique advantage of the time series design is its ability to distinguish temporary from 
permanent changes. Exhibit 12.8 shows some possible outcomes in a time series experiment. 


Complex Experimental Designs 


The previous discussion focused on simple experimental designs—experiments manipulating a 
single variable. Here, the focus shifts to more complex experimental designs involving multiple 
experimental variables. Complex experimental designs are statistical designs that isolate the effects 
of confounding extraneous variables or allow for manipulation of more than one independent 
variable in the experiment. Completely randomized designs, randomized block designs, and factorial 
designs are covered in the following section. 
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COMPLETELY RANDOMIZED DESIGN 


A completely randomized design is an experimental design that uses a random process to assign 
subjects to treatment levels of an experimental variable. Randomization of experimental units is 
the researcher’s attempt to control extraneous variables while manipulating potential causes. A 
one-variable experimental design can be completely randomized, so long as subjects are assigned 
in a random way to a particular experimental treatment level. 

Consider a financial institution that wants to increase their response to credit card offers. An 
experiment is constructed to examine the effects of various incentives on the percentage of poten- 
tial customers that apply for a credit card with the institution. Thus, the experimental variable is 
the incentive. This can be manipulated over three treatment levels: 


1. No incentive to the control group 
2. No interest for the first 90 days with an approved application 
3. A free MP3 player with an approved application 


The financial institution rents a mailing list of 15,000 prospects. This sample frame is divided into 
three groups of 5,000 each (n, + n, + n, = 15,000). A random number process could be used 
to assign subjects to one of the three groups. Suppose each of the 15,000 subjects is assigned a 
number ranging from 1 to 15,000. If a random number is selected between 1 and 15,000 (i.e., 
1,201), that person can be assigned to the first group, with every third person afterward and before 
also assigned to the first group (1,204, 1,207, 1,210 . . . all the way back to 1,198). The process 
can be repeated with the remaining 10,000 subjects by selecting a random number between 1 
and 10,000 and then selecting every other subject. At this point, only 5,000 subjects remain and 
will comprise the third group. All 15,000 subjects are now assigned to one of three groups. Each 
group corresponds to one of the three levels of incentive. A variable representing which group 
a subject belongs to becomes the independent variable. The dependent variable is measured for 
each of the three treatment groups and the number of respondents to the offer is determined. The 
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XHIBIT 12.8 
Selected Time Series 
Outcomes 


completely randomized 
design 


An experimental design that 
uses a random process to assign 
subjects to treatment levels of an 
experimental variable. 
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randomized-block design 


A design that attempts to isolate 
the effects of a single extrane- 
ous variable by blocking out its 
effects on the dependent 
variable 
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analysis would compare differences across the number of respondents for each of the three treat- 
ment levels. 


RANDOMIZED-BLOCK DESIGN 


The randomized-block design is an extension of the completely randomized design. A form of ran- 
domization is used to control for most extraneous variation; however, the researcher has identified 
a single extraneous variable that might affect subjects’ responses systematically. The researcher will 
attempt to isolate the effects of this single variable by blocking out its effects. 

A blocking variable is a categorical variable that is expected to be associated with different 
values of a dependent variable for each group. Sex is a common blocking variable. Many 
potential dependent variables are expected to be different for men and women. For instance, 
work-family conflict—conflict between the obligations a person has to their family and with 
their work commitments—has been found to differ between women and men. So, if a researcher 
is studying how salary and length of vacation time affects employee job satisfaction, they may 
want to also record a person’s sex and include it as an extra explanatory variable over and above 
the experimental variable’s salary and vacation time. The concept of a blocking variable was intro- 
duced in the self-efficacy study where the researchers “blocked” on length of time the subjects had 
been an employee (new versus current). 

The term randomized block originated in agricultural research that applied several levels of a 
treatment variable to each of several blocks of land. Systematic differences in agricultural yields due 
to the quality of the blocks of land may be controlled in the randomized-block design. In business 
research, the researcher may wish to isolate block effects such as bank branch territories, job work 
units, or employee tenure, and so on. Suppose that a manufacturer of Mexican food is consider- 
ing two packaging alternatives. Marketers suspect that geographic region might confound the 
experiment. They have identified three regions where attitudes toward Mexican food may differ 
(the Southwest, the Midwest, and the Atlantic Coast). In a randomized-block design, each block 
must receive every treatment level. Assigning treatments to each block is a random process. In this 
example the two treatments will be randomly assigned to different cities within each region. 

Sales results such as those in Exhibit 12.9 might be observed. The logic behind the randomized- 
block design is similar to that underlying the selection of a stratified sample rather than a simple 
random one. By isolating the block effects, one type of extraneous variation is partitioned out 
and a more efficient experimental design therefore results. This is because experimental error is 
reduced with a given sample size. 


EXHIBIT 12.9 Randomized Block Design 


Treatment 


Percentage Who Purchase Product 


Package A 
Package B 


Mean for cities 


Southwest Midwest Atlantic Coast Mean for Treatments 
14.0% (Phoenix) 12.0% (St. Louis) 7.0% (Boston) 11.0% 
16.0% (Albuquerque) 15.0% (Peoria) 10.0% (New York) 13.6% 
15.0% 13.5% 8.5% 
FACTORIAL DESIGNS 


Suppose a human resource manager believes that an experiment that manipulates the level of salary 
offered is useful, but too limited. The recruiters for the firm have been visiting college campuses 
and know that graduates seeking jobs are concerned about salary, but they are also concerned 
about the number of vacation days they will receive. However, the level of salary and actual num- 
ber of vacation days needs to determined. Thus, an experiment to assess this requires more than 
one independent variable be incorporated into the research design. Even though the single-factor 
experiments considered so far may have one specific variable blocked and other confounding 
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sources controlled, they are still limited. A factorial design allows for the testing of the effects of 
two or more treatments (factors) at various levels. 

We discussed earlier in this chapter that experiments produce main effects and interactions. 
Main effects are differences (in the dependent variable) between treatment levels. Interactions pro- 
duce differences (in the dependent variable) between experimental cells based on combinations of 
variables. In the self-efficacy example, we learned that the experimental treatment had a stronger 
effect on the current employees than the new employees (see Exhibit 12.3). 

To further explain the terminology of experimental designs, let us develop the recruiting 
experiment more fully. The human resource manager wants to measure the effect of the salary and 
vacation days on the percentage of job offers accepted. Exhibit 12.10 indicates three treat- 
ment levels of salary offered ($37,500, $40,000, and $42,500) and two levels of vacation time 
(10 days and 14 days). The table shows that every combination of treatment level requires a sepa- 
rate experimental group. In this experiment, with three levels of salary and two levels of vacation, 
we have a 3 X 2 (read “three by two”) factorial design because the first factor (the salary variable) 
is varied in three ways and the second factor (the location variable) is varied in two ways. A 3 X 2 
design requires six cells, or six experimental groups (3 X 2 = 6). If the subjects each receive only 
one combination of experimental variables, then we use the term 3 X 2 between-subjects design 
to describe the experiment. 


Vacation Days 


10 Days 
$37,500 Cell 1 Cell 4 
$40,000 Cell 2 Cell 5 
$42,500 Cell 3 Cell 6 


The number of treatments (factors) and the number of levels of each treatment identify the 
factorial design. A 3 X 3 design means there are two factors, each having three levels; a2 X 2 X 2 
design has three factors, each having two levels. The treatments need not have the same number of 
levels; for example, a 3 X 2 X 4 factorial design is possible. The important idea is that in a factorial 
experiment, each treatment level is combined with every other treatment level. 

In addition to the advantage of investigating two or more independent variables simultane- 
ously, factorial designs allow researchers to measure interaction effects. Ina 2 X 2 experiment the 
interaction is the effect produced by treatments A and B combined. If the effect of one treatment 
differs at various levels of the other treatment, interaction occurs. 

To illustrate the value of a factorial design, suppose a researcher is comparing two magazine 
ads. The researcher is investigating the believability of ads on a scale from 0 to 100 and wishes to 
consider the sex of the reader as a blocking factor. The experiment has two independent variables: 
sex and ads. This 2 X 2 factorial experiment permits the experimenter to test three hypotheses. 
Two hypotheses examine the main effects: 


e Advertisement A is more believable than ad B. 
e Men believe advertisements more than women. 


However, the primary research question may deal with the interaction hypothesis: 


e Advertisement A is more believable than ad B among women, but ad B is more believable 
than ad A among men. 


A high score indicates a more believable ad. Exhibit 12.11 on the next page shows that the 
mean believability score for both sex is 65. This suggests that there is no main sex effect. Men and 
women evaluate believability of the advertisements equally. The main effect for ads indicates that 
ad A is more believable than ad B (70 versus 60), supporting the first hypothesis. However, if we 
inspect the data and look within the levels of the factors, we find that men find ad B more believ- 
able and women find ad A more believable. This is an interaction effect because the believability 
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factorial design 


A design that allows for the test- 
ing of the effects of two or more 
treatments (experimental vari- 
ables) at various levels 


EXHIBIT 12.10 
Factorial Design—Salary 
and Vacation 


e Survey research can not determine cause and effect; experi- 
ments are the only method available to a business researcher 
to establish causality. 

e Sample size and random assignment are the experimental 
researcher's friends. 

e For experiments to be valid, we need to know the subjects 
in the different experimental groups are equal. It is virtu- 
ally impossible to identify and assess all the characteristics 
that could affect an experiment. However, if we have 
a large enough sample size (cell count) and randomly 
assign subjects to the experimental groups, all character- 
istics should balance out. 


We must establish both internal and 
external validity of our experiments. 


Establishing internal validity first 

makes sense—if we cannot show that our 

independent variable is the cause of the 

observed change in our dependent vari- 

able, there is no reason to consider external validity. 
Laboratory experiments are better suited to establishing 
internal validity, while field experiments are more effec- 
tive at establishing external validity. Thus, we typically 
move from the laboratory to the field. 


score of the advertising factor differs at different values of the other independent variable, sex. 
Thus, the interaction hypothesis is supported. 

Exhibit 12.12 graphs the results of the believability experiment. The line for men represents 
the two mean believability scores for ads A and B. The other line represents the same relationship 
for women. Notice the difference between the slopes of the two lines. This also illustrates support 
for the interaction of the ad copy with biological sex. The difference in the slopes means that the 
believability of the advertising copy depends on whether a man or a woman is reading the adver- 


tisement. We witnessed a similar effect in our self-efficacy example. 


EXHIBIT 12.11 A2 X 2 


Factorial Design That aaa Ad B 
Illustrates the Effects of 
Sex and Ad Content on 
Believabilit Men ae 70 65 
y Main effects of sex 
Women 80 50 65 
70 60 
— amam 


EXHIBIT 12.12 Graphic 
Illustration of Interaction 
Between Sex and 
Advertising Copy 


Believability 
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Summary 


1. Identify the independent variable, dependent variable, and construct a valid simple experi- 
ment to assess a cause and effect relationship. Independent variables are created through 
manipulation in experiments rather than through measurement. The researcher creates unique 
experimental conditions that represent unique levels of an independent variable. In our pro- 
tocol example, the researcher manipulated the type of protocol used for the transmission of 
financial data. In the self-efficacy study, the subjects were either given or not given the treat- 
ment. Levels of an independent variable should be different enough to represent meaning- 
ful categories. The dependent variable(s) must be outcome measures that are anticipated to 
change based on the differing levels of the independent variable. The researchers expected 
the speed of data transmission to differ based on the protocol used. In the self-efficacy study, 
job satisfaction (and other key dependent variables) was expected to change if self-efficacy 
was enhanced. 


2. Understand and minimize systematic experimental error. Systematic experimental error 
occurs because sampling units (research subjects) in one experimental cell are different from 
those in another cell in a way that affects the dependent variable. In the self-efficacy study, it is 
important to have employees randomly assigned to the experiment or control group, rather than 
choosing those employees that appear to most need their self confidence enhanced to be exposed 
to the treatment. Randomization is an important way of minimizing systematic experimental 
error. If research subjects are randomly assigned to different treatment combinations, then the 
differences among people that exist naturally within a population should also exist within each 
experimental cell. 


3. Know ways of minimizing experimental demand characteristics. Demand characteristics 
are experimental procedures that somehow inform the subject about the actual research pur- 
pose. Demand effects can result from demand characteristics. When this happens, the results 
are confounded. Demand characteristics can be minimized by following these simple rules: 
using an experimental disguise, isolating experimental subjects, using a “blind” experimen- 
tal administrator, and administering only one experimental treatment combination to each 
subject. 


4. Avoid unethical experimental practices. Experiments naturally involve deception. Additionally, 
research subjects are sometimes exposed to stressful or possibly dangerous manipulations. Every 
precaution should be made to ensure that subjects are not harmed. Debriefing subjects about the 
true purpose of the experiment following its conclusion is important for the ethical treatment of 
subjects. If debriefing can restore subjects to their pre-experimental condition, the experimental 
procedures are likely consistent with ethical practice. If subjects are affected in some way that 
makes it difficult to return them to their prior condition, then the experimental procedures prob- 
ably go beyond what is considered ethical. 


5. Understand the advantages of a between-subjects experimental design. A between-subjects 
design means that every subject receives only one experimental treatment combination. In a 
within-subjects design the subjects receive multiple treatments and measurements. The main 
advantages of between-subjects designs are the reduced likelihood of demand effects and simpler 
analysis and presentation. 


6. Weigh the trade-off between internal and external validity. Lab experiments, such as the pro- 
tocol example, offer higher internal validity because they maximize control of extraneous vari- 
ables. High internal validity is a good thing because we can be more certain that the experimental 
variable is truly the cause of any variance in the dependent variable. Field experiments, such as 
the self-efficacy study, maximize external validity because they are conducted in a more natural 
setting meaning that the results are more likely to generalize to the actual business situation. The 
increased external validity comes at the expense of internal validity. 


7. Use manipulations to implement a completely randomized experimental design, a 
randomized-block design, and a factorial experimental design. The key to randomization is to 
assign subjects to experimental cells in a way that spreads extraneous variables out evenly across 
every condition. Blocking variables can be added to simple randomized experimental designs to 
control for categorical variables that are expected to be related to the dependent variable. Finally, 
a factorial design results when multiple experimental and/or blocking variables are included in a 
single model. Both main effects and interactions result. 
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Key Terms and Concepts 


basic experimental design, 278 
between-subjects design, 274 
blocking variables, 258 

cell, 263 

cohort effect, 276 

completely randomized design, 283 
confound, 265 

constancy of conditions, 270 
control group, 261 
counterbalancing, 270 
demand characteristic, 267 
demand effect, 267 
experimental condition, 258 
experimental group, 261 
experimental treatment, 261 


external validity, 277 
extraneous variables, 266 
factorial design, 285 

field experiments, 272 
Hawthorne effect, 268 
history effect, 275 
instrumentation effect, 276 
interaction effect, 260 
internal validity, 274 
laboratory experiment, 271 
main effect, 259 
manipulation check, 275 
maturation effects, 276 


mortality effect (sample attrition), 277 


nuisance variables, 264 
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placebo, 269 

placebo effect, 269 
quasi-experimental designs, 278 
randomization, 264 
randomized-block design, 284 
repeated measures, 263 
selection effect, 277 

subjects, 258 

systematic or nonsampling error, 264 
tachistoscope, 272 

test units, 264 

testing effects, 276 

time series design, 282 
within-subjects design, 273 


Questions for Review and Critical Thinking 


1. Define experimental condition, experimental treatment, and experi- 8. 


mental group. How are these related to the implementation of a 


valid manipulation? 


2. A tissue manufacturer that has the fourth-largest market share 


plans to experiment with a 50¢ off coupon during November 


and a buy one, get one free coupon during December. The 9. 


experiment will take place at Target stores in St. Louis and 


Kansas City. Sales will be recorded by scanners from which 


mean tissue sales for each store for each month can be com- 


puted and interpreted. 


10. 


a. What are the independent variable and the dependent 


variable? 


b. Prepare a “dummy” table that would describe what the 


3. What is the difference between a main effect and an interaction in 
an experiment? In question 2, what will create a main effect? Is 
an interaction possible? 
4. In what ways might the design in question 2 yield systematic or 
nonsampling error? Ti. 
5. What purpose does the random assignment of subjects serve? 
6. Why is an experimental confound so damaging to the conclu- 12. 
sions drawn from an experiment? 
7. What are demand characteristics? How can they be minimized? 


results of the experiment would look like. 


Research Activities 


Consider the following scenario: 

Sea Snapper brand gourmet frozen fish products claimed in 
advertising that their fish sticks are preferred more than two 
to one over the most popular brand, Captain John’s. The 
advertisements all include a definitive statement indicating that 
research existed which substantiated this claim. 

Captain John’s reaction was war; or at least legal war. They 
decided to sue Sea Snapper claiming that the advertisements 
include false claims based on faulty research. In court, the 
research is described in great detail. Sea Snapper conducted taste 


ETHICS Suppose researchers were experimenting with how 
much more satisfied consumers are with a “new and improved” 
version of some existing product. How might the research- 

ers design a placebo within an experiment testing this research 
question? Is using such a placebo ethical or not? 

If a company wanted to know whether to implement a new 
management training program based on how much it would 
improve ROI in its southwest division, would you recommend 
a field or lab experiment? 

‘NET Suppose you wanted to test the effect of three differ- 

ent e-mail requests inviting people to participate in a survey 
posted on the Internet. One simply contained a hyperlink with 
no explanation, the other said if someone participated $10 
would be donated to charity, and the other said if someone 
participated he or she would have a chance to win $1,000. 
How would this experiment be conducted differently based on 
whether it was a between-subjects or within-subjects design? 
What are the advantages of a between-subjects design? 

What is a manipulation check? How does it relate to internal 
validity? 

ETHICS What role does debriefing play in ensuring that experi- 
mental procedures are consistent with good ethical practice? 


tests involving four hundred consumers who indicated that they 
regularly ate frozen food products. Two hundred tasted Sea 
Snapper premium fish sticks and the other two hundred tasted 
Captain John’s premium fish sticks. Consumer preference was 
measured with a 100-point rating scale. The results showed the 
average preference score for Sea Snapper was 78.2 compared to 
39.0 for Captain John’s. 

Captain John’s attorney hires a research firm to assist in 
the lawsuit. They claim that the research is faulty because the 
procedures were improperly conducted. First, it turns out that 
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Sea Snapper fish sticks were always presented to consumers 

on a blue plate while Captain John’s were always presented to 

consumers on an orange plate. Second, the Sea Snapper prod- 

ucts used in the experiment were taken directly from the Sea 

Snapper kitchens to the testing facility, while the Captain John’s 

products were purchased at a local warehouse store. 

a. Provide a critique of the procedures used to support the 
claim that Sea Snapper’s product is superior. Prepare it in a 
way that it could be presented as evidence in court. 

b. Design an experiment that would provide a more valid test 
of the research question, “Do consumers prefer Sea Snapper 
fish sticks compared to Captain John’s fish sticks?” 
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2. Conduct a taste test involving some soft drinks with a group of 
friends. Pour them several ounces of three popular soft drinks 
and simply label the cups A, B, and C. Make sure they are 
blind to the actual brands. Then, let them drink as much as 
they want and record how much of each they drink. You may 
also ask them some questions about the drinks. Then, allow 
other subjects to participate in the same test, but this time, let 
them know what the three brands are. Record the same data 
and draw conclusions. Does brand knowledge affect behavior 
and attitudes about soft drinks? 


Case 12.1 Tooheys 


Sixty-six willing Australian drinkers helped a 
Federal Court judge decide that Tooheys didn’t 
engage in misleading or deceptive advertising 
for its 2.2 beer. The beer contains 2.2 percent 
alcohol, compared to 6 percent for other beers, 
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leading to a claim that could be interpreted as 
implying it was non-alcoholic. 

Volunteers were invited to a marathon drinking session after 
the Aboriginal Legal Service claimed Tooheys’ advertising implied 
beer drinkers could imbibe as much 2.2 as desired without becom- 
ing legally intoxicated. Drunken driving laws prohibit anyone with 
a blood-alcohol level above 0.05 from getting behind the wheel in 
Australia. 

So, an experiment was conducted to see what happens when a 
lot of 2.2 is consumed. But the task wasn’t easy or that much fun. 
Some subjects couldn’t manage to drink the required 10 “middies,” 
an Aussie term for a beer glass of 10 fluid ounces, over the course 
of an hour. 

Thirty-six participants could manage only nine glasses. Four 
threw up and were excluded. Two more couldn’t manage the 
“minimum” nine glasses and had to be replaced. 


Justice J. Beaumont observed that consuming enough 2.2 in an 
hour to reach the 0.05 level was “uncomfortable and therefore an 
unlikely process.” Because none of the ads mentioned such extreme 
quantities, he ruled they couldn’t be found misleading or deceptive. 


Questions 

1. Would a lab experiment or a field experiment be more “valid” 
in determining whether Tooheys could cause a normal beer 
consumer to become intoxicated? Explain. 

2. Describe an alternate research design that would have higher 
validity. 

3. Is the experiment described in this story consistent with 
good ethical practice? Likewise, comment on how the design 
described in part 2 would be made consistent with good ethical 
practices. 

4. Is validity or ethics more important? 


CHAPTER 13 
MEASUREMENT 
AND SCALING 
CONCEPTS 


1. Determine what needs to be measured to address a 
research question or hypothesis 


2. Distinguish levels of scale measurement 


3. Know how to form an index or composite measure 
4. List the three criteria for good measurement 


5. Perform a basic assessment of scale reliability 
and validity 


Chapter Vignette—Money Matters? 


Griff Mitchell is the vice president of customer relationship management (CRM) for one of the 

world’s largest suppliers of industrial heavy equipment. In this role, he oversees all sales and 

service operations. This year, for the first time, the company has decided to perform a CRM 
employee evaluation process that will allow an overall ranking of all CRM employees. Griff knows 
this will be a difficult task for many reasons, not the least of which is that he oversees over a 
thousand employees worldwide. 

The ranking will be used to single out the best performers. These employees will be recog- 
nized at the company’s annual CRM conference. The rankings will also be used to identify the 
lowest 20 percent of performers. These employees will be put on a probationary list with specific 
targeted improvement goals that will have to be met within 12 months or they will be fired. Griff 

is becoming really stressed out trying to define the performance ranking process. 

Griff's key question is, “What is performance?” Although these employees are now often 
referred to as CRM employees, they have traditionally performed the sales function. Griff calls a 
meeting of senior CRM managers to discuss how ranking decisions should be made. 

One manager simply argues that sales volume should be the sole criteria. She believes that 
“sales figures provide an objective performance measure that will make the task easy 
and difficult to refute.” Another counters that for the past 
22 years, he has simply used his opin- 

ion of each employee's performance 
to place each of them into one of three 


groups: top performers, good perform- 
ers, and underperformers. “I think about 
who is easy to work with and doesn’t 
cause much trouble. It has worked for 
22 years, why won't it work now?” Another 
responds curtly, “It’s margin! It’s margin! | 
don’t care about sales volume; | want my 
guys selling things that improve my divi- 
sion’s profit!” One of the newer managers 
sits silently through most of the meeting 
and finally summons up the courage to 
speak. “Aren't we CRM? That means perfor- 
mance should not be tied to sales, profits, 
or convenience, it should be based on how 
well a salesperson builds and maintains 
relationships with customers. So, we should 
see how satisfied the customers assigned to 
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EXHIBIT 13.1 More Ways 
Than One to Measure 
Ingredients 
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the employee are and use this in the evaluation process!” After this, the meeting disintegrates into a 
shouting match with each manager believing the others’ ideas are flawed. 

Griff feels like he is back to square one. “How do I make sure | have a valid performance 
measure so that all of our people are treated fairly?” He decides to seek out an opinion from a 
long-time friend in the research business, Robin Donald. Robin suggests that a research project 
may be needed to define a reliable and valid measure. She also brings up the fact that because 
employees from all over the world will be considered, the measure will have to maintain its reli- 
ability and validity anywhere it is used! Griff agrees to the project. He also feels good about let- 
ting someone outside the company develop the measure, because he certainly realizes the 
tremendous challenges that are present. 

Griff’s situation in this vignette illustrates how difficult it can be to define, let alone measure, 
important business phenomena. While some items can be measured quite easily, others present 
tremendous challenges to the business researcher. This is the first of two chapters that deal with mea- 
surement in business research. 


Introduction 


Not every cook or chef needs to follow a recipe to create a great dish, but most amateur chefs find 
one very useful. Look at Exhibit 13.1. The recipe shows ingredients that can produce a tasty chicken 
dish. However, many readers, even those with some cooking ability, may have a difficult time fol- 
lowing this recipe. Why? First, many may have difficulty translating all the French terms. Second, 


(a) Recette de la Jour (b) Dogtes de Poulet Faibles avec Crackers 


454g Poitrine de Poulet 


50 ml Farine Tout Usage 
2ml De Poudre d’Ail 
2ml De Poudre d’Oignon 
1ml De Sel 

2 Blancs d’Oeuf 

50 ml De Lait Ecrémé 


Pincée De le Poivre Rouge 


36 Crackers 
(Tout Crounche) 
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ji H A comprehensive survey like this one 
$ involves many different types of measure- 
A V ment. The questionnaire used in this sur- 
Z vey contains multiple scale measurement 
K levels. Try to identify one of each of the four 
categories of scale measurement. Then take a 
look at the questions shown below. What scale measurement 
level do these items represent? Each set of items is designed 
to capture a single construct. In the top, the items assess how 
much work-life interferes with nonwork-life. In the lower por- 
tion, the scales assess self-perceived performance. For each 
scale, compute a coefficient a to estimate reliability and then 
create a composite scale by summing the items that make up 
that particular scale. 
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Lam the Dest at pertorming my 
particular job 

lamin the top 10 percent of all = 

employees o j ° 
1 know more about my job than 

mostof my coworkers 


l receive more incentive pay 
than mast of my coworkers 


Done 


even when this is done, many will have difficulty knowing just what amounts of what ingredients 
should be included. How many could easily deal with the different measures listed by the ingre- 
dients? “How much is 50 ml?” “What is 454 g?” “How much is a pinch?” “Can I use my normal 
measuring utensils (scales)?” 

Likewise, the chapter vignette describes a situation in which Griff must develop a “recipe” 
for distinguishing employees based on job performance. Before the measurement process can be 
defined, he will have to decide exactly what it is that needs to be produced. In this case, the out- 
come should be a valid job performance measure. 


What Do I Measure? 


The decision statement, corresponding research questions, and research hypotheses can be used 
to decide what concepts need to be measured in a given project. Measurement is the process of 
describing some property of a phenomenon of interest, usually by assigning numbers in a reli- 
able and valid way. The numbers convey information about the property being measured. When 
numbers are used, the researcher must have a rule for assigning a number to an observation in a 
way that provides an accurate description. 

Measurement can be illustrated by thinking about the way instructors assign students’ grades. A 
grade represents a student’s performance in a class. Students with higher performance should receive 
a different grade than do students with lower performance. Even the apparently simple concept of 
student performance is measured in many different ways. Consider the following options: 


1. A student can be assigned a letter corresponding to his/her performance. 
a. A — Represents excellent performance 

B — Represents good performance 

C — Represents average performance 

D — Represents poor performance 

F — Represents failing performance 


oann 


2. A student can be assigned a number from 1 to 20. 
a. 20 — Represents outstanding performance 
b. 11-20 — Represents differing degrees of passing performance 
c. Below 11 — Represents failing performance 


o o © 
(e7 (a7 2 
| 
@ internet A75% + 


measurement 


The process of describing some 
property of a phenomenon of 
interest, usually by assigning 
numbers in a reliable and valid 
way. 
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Peer Pressure and Investing Behavior 
Do friends influence your purchase decisions? Are the clothes 
you buy based on the approval of others? While we all have 
experienced “peer pressure,” research has shown that some indi- 
viduals are more susceptible to such pressure than others. Most 
often, researchers have thought of this interpersonal influence to 
be present in conspicuous consumption or socially visible prod- 
ucts. Recent research, however, shows such influence can occur 
even in the selection of less visible products and services, includ- 
ing investments. 

Researchers used the construct susceptibility to interpersonal 
influence (SCII) to investigate how information obtained from others 
affects investment decisions. First, this construct had to be concep- 
tualized and measured. Based on earlier studies, SCII is thought to 
be composed of two parts—susceptibility to informational influences 
(SII) and susceptibility to normative influences (SNI). Susceptibility to 
informational influences captures the willingness of a person to 
accept information from another as reality. Information is gained 
either from asking others 
for advice or observing their 
actions. Susceptibility to nor- 
mative influences is a person's 
willingness to comply with 
the expectations of others. SNI 


is motivated by a desire to build self-image 
through association with some other person 
or group. Questions were developed to mea- 
sure both SII and SNI, together capturing the 
domain of SCII. 

The research found: 


e Respondents that do not have sufficient investment knowl- 
edge, and have strong social needs, perceive high levels of 
risk associated with investing and are particularly susceptible 
to interpersonal influences. 

e Respondents with greater susceptibility to informational 
influences trade less, while individuals with greater suscepti- 
bility to normative influences trade more. 

e Respondents do react to outside influence, to the point that 
they are willing to sacrifice investment returns for social rewards. 


Consumers need to carefully consider the information they 
are exposed to and the investment decisions they make. Are they 
choosing what they believe to be the best investment, or one 
that wins them favor with their friends? 


Source: Hoffmann, A. O. |. and T. L. J. Broekhuizen, “Susceptibility to and Impact 
of Interpersonal Influence in an Investment Context,” Journal of the Academy of 
Marketing Science, doi 10.1007/s11747-008-0128-7 (forthcoming), published with 
open access at http://springerlink.com. 


3. A student can be assigned a number corresponding to a percentage performance scale. 
a. 100 percent — Represents a perfect score. All assignments are performed correctly. 


b. 60-99 percent — Represents differing degrees of passing performance, each number rep- 


resenting the proportion of correct work. 


c. 0-59 percent — Represents failing performance but still captures proportion of correct 


work. 


4. A student can be assigned one of two letters corresponding to performance. 
a. P— Represents a passing mark 


b. F— Represents a failing mark 


Actually, this is not terribly different than a manager who must assign performance scores to 


employees. In each case, students with different marks are distinguished in some way. However, 
ploy g y 


some scales may better distinguish students. Each scale also has the potential of producing error or 


some lack of validity. Exhibit 13.2 illustrates a common measurement application. 


Often, instructors may use a percentage scale all semester long and then be required to assign 


a letter grade for a student’s overall performance. Does this produce any measurement problems? 


Consider two students who have percentage scores of 79.4 and 70.0, respectively. The most 
likely outcome when these scores are translated into “letter grades” is that each receives a C (the 
common 10-point spread would yield a 70-80 percent range for a C). Consider a third student 
who finishes with a 69.0 percent average and a fourth student who finishes with a 79.9 percent 


average. 


Which students are happiest with this arrangement? The first two students receive the same 


grade, even though their scores are 9.4 percent apart. The third student gets a grade lower (D) 


performance than the second student, even though their percentage scores are only 1.0 percentage 
point different. The fourth student, who has a score only 0.5 percent higher than the first stu- 
dent, would receive a B. Thus, the measuring system (final grade) suggests that the fourth student 
outperformed the first (assuming that 79.9 is rounded up to 80) student (B versus C), but the first 
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1 79.4% 0.5% C 
2 70.0% 9.4% C 
3 69.0% 1.0% D 
4 79.9% NA B 


student did not outperform the second (each gets a C), even though the first and second students 
have the greatest difference in percentage scores. 

A strong case can be made that error exists in this measurement system. All measurement, par- 
ticularly in the social sciences, contains error. Researchers, if we are to represent concepts truth- 
fully, must make sure that the measures used, if not perfect, are accurate enough to yield correct 
conclusions. Ultimately, research and measurement are tied closely together. 


Concepts 


A researcher has to know what to measure before knowing how to measure something. The 
problem definition process should suggest the concepts that must be measured. A concept can 
be thought of as a generalized idea that represents something of meaning. Concepts such as age, 
sex, education, and number of children are relatively concrete properties. They present few problems 
in either definition or measurement. Other concepts are more abstract. Concepts such as loyalty, 
personality, channel power, trust, corporate culture, customer satisfaction, value, and so on are more dif- 
ficult to both define and measure. For example, loyalty has been measured as a combination of 
customer share (the relative proportion of a person’s purchases going to one competing brand/store) 
and commitment (the degree to which a customer will sacrifice to do business with a brand/store).! 
Thus, we can see that loyalty consists of two components, the first is behavioral and the second 
is attitudinal. 


Operational Definitions 


Researchers measure concepts through a process known as operationalization. This process 
involves identifying scales that correspond to variance in the concept. Scales, just as a scale you 
may use to check your weight, provide a range of values that correspond to different values in the 
concept being measured. In other words, scales provide correspondence rules that indicate that a 
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EXHIBIT 13.2 

Are There Any Validity 
Issues with This 
Measurement? 


concept 


A generalized idea that repre- 
sents something of meaning. 


operationalization 


The process of identifying scales 
that correspond to variance in 

a concept to be involved in a 
research process. 


scales 


A device providing a range of 
values that correspond to differ- 
ent values in a concept being 
measured. 


correspondence rules 


Indicate the way that a certain 
value on a scale corresponds to 
some true value of a concept. 
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construct 


A term used to refer to concepts 
measured with multiple variables. 
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certain value on a scale corresponds to some true value of a concept. Hopefully, they do this in a 
truthful way. 

Here is an example of a correspondence rule: “Assign the numbers 1 through 7 according to 
how much trust that you have in your sales representative. If the sales representative is perceived 
as completely untrustworthy, assign the numeral 1, if the sales rep is completely trustworthy, 
assign a 7.” 


VARIABLES 


Researchers use variance in concepts to make diagnoses. Therefore, when we defined variables in 
an earlier chapter, we really were suggesting that variables capture different concept values. Scales 
capture variance in concepts and, as such, the scales provide the researcher’s variables. Thus, for 
practical purposes, once a research project is underway, there is little difference between a concept 
and a variable. Consider the following hypothesis: 


H1: Experience is positively related to job performance. 


The hypothesis implies a relationship between two variables, experience and job performance. 
The variables capture variance in the experience and performance concepts. One employee may 
have 15 years of experience and be a top performer. A second may have 10 years experience 
and be a good performer. The scale used to measure experience is quite straightforward in this 
case and would involve simply providing the number of years an employee has been with the 
company. Job performance, on the other hand, can be quite complex, as described in the open- 
ing vignette. 


CONSTRUCTS 


Sometimes, a single variable cannot capture a concept alone. Using multiple variables to measure 
one concept can often provide a more complete account of some concept than could any single 
variable. Even in the physical sciences, multiple measurements are often used to make sure an 
accurate representation is obtained. In social science, many concepts are measured with multiple 
measurements. 

A construct is a term used for concepts that are measured with multiple variables. For instance, 
when a business researcher wishes to measure the customer orientation of a salesperson, several 
variables like these may be used, each captured on a 1-5 scale: 


1. I offer the product that is best suited to a customer’s problem. 
2. A good employee has to have the customer’s best interests in mind. 
3. I try to find out what kind of products will be most helpful to a customer.’ 


Constructs can be very helpful in operationalizing a concept. 

An operational definition is like a manual of instructions or a recipe: even the truth of a 
statement like “Gaston Gourmet likes key lime pie” depends on the recipe. Different instructions 
lead to different results. In other words, how we define the construct will affect the way we 
measure it.’ 

An operational definition tells the investigator, “Do such-and-such in so-and-so manner.””* 
Exhibit 13.3 presents a concept definition and an operational definition from a study on a con- 


struct called susceptibility to interpersonal influence. 


Levels of Scale Measurement 


Business researchers use many scales or number systems. Not all scales capture the same rich- 
ness in a measure. Not all concepts require a rich measure. Traditionally, the level of scale 
measurement is seen as important because it determines the mathematical comparisons that are 
allowable. The four levels or types of scale measurement are nominal, ordinal, interval, and ratio 
level scales. Each type offers the researcher progressively more power in analyzing and testing 
the validity of a scale. 
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EXHIBIT 13.3 Susceptibility to Interpersonal Influence: An Operational Definition 


Concept 


Susceptibility 
to interpersonal 
influence 


Conceptual Definition 


Susceptibility to 
interpersonal influence is 
“the need to identify with or 
enhance one’s image in the 
opinion of significant others 
through the acquisition 

and use of products and 
brands, the willingness to 
conform to the expectations 
of others regarding 
purchase decisions, and/ 

or the tendency to learn 
about products and services 
by observing others or 
seeking information from 
others.” Susceptibility to 
interpersonal influence is 

a general trait that varies 


Operational Definition 


Please tell me how much you agree or disagree with each of the following 
statements: 


1. | frequently gather information about stocks from friends or family before | invest 
in them. 

2. To make sure | buy the right stock, | often observe what other investors invest in. 

3. | often consult other people to help choose the best stock to invest in. 


4. If | have little experience with a (type of) stock, | often ask my friends and 
acquaintances about the stock. 


5. | like to know what investment decisions make good impressions on others. 
6. | generally purchase those stocks that | think others will approve of. 


7. | often identify with other people by purchasing or selling the same stocks they 
sell or purchase. 


8. | achieve a sense of belonging by purchasing or selling the same stocks that others 
purchase or sell. 


9. If others can see in which stocks | invest, | often invest in stocks that they invest in. 


across individuals. 


Sources: Bearden, W. O., R. G. Netemeyer, and M. F. Mobley, Handbook of Marketing Scales: Multi Item Measures for Marketing and Consumer Behavior Research, 2nd ed. 
(Newbury Park, Calif: Sage Publications, 1999); Hoffmann, A. O. I. and T. L. J. Broekhuizen, “Susceptibility to and Impact of Interpersonal Influence in an Investment 
Context,” Journal of the Academy of Marketing Science doi 10.1007/s11747-008-0128-7 (forthcoming), published with open access at http://springerlink.com. 


nominal scales 


Represent the most elementary 
level of measurement in which 
values are assigned to an object 
for identification or classification 
purposes only. 


Nominal Scale 


Nominal scales represent the most elementary level of measurement. A nominal scale assigns a 
value to an object for identification or classification purposes only. The value can be, but does not 


have to be, a number because no quantities are being represented. In this sense, a nominal scale is , 
Athletes wear nominal 


numbers on their jerseys. Ben 
Roethlisberger wears number 7 
for the Pittsburgh Steelers, while 
Marvel Smith wears number 77. 
This does not mean that Marvel 
is 11 times better than Ben, or 
bigger than Ben, or faster than 
Ben, or anything else. 


truly a qualitative scale. Nominal scales are extremely useful, and are sometimes the only appropri- 
ate measure, even though they can be considered elementary. 

Business researchers use nominal scales quite often. Suppose Barq’s Root Beer was experiment- 
ing with three different types of sweeteners (cane sugar, corn syrup, or fruit extract). The research- 
ers would like the experiment to be blind, so when subjects are asked to taste one of the three root 
beers, the drinks are labeled A, B, or C, not cane sugar, corn syrup, or fruit extract. Or, a researcher 
interested in examining the production efficiency of a company’s different 
plants might refer to them as “Plant 1,” “Plant 2,” and so forth. 

Nominal scaling is arbitrary. What we mean is that each label can be 
assigned to any of the categories without introducing error. For instance, in 
the root beer example above, the researcher can assign the letter C to any of 
the three options without damaging scale validity. The researcher could just 
as easily use numbers instead of letters, as in the plant efficiency example, and 
vice versa. If so, cane sugar, corn syrup, and fruit extract might be identi- 
fied with the numbers 1, 2, and 3, respectively, or even 543, 26, and 2010, 
respectively. The important thing to note is the numbers are not represent- 
ing different quantities or the value of the object. Thus any set of numbers, 
letters, or any other identification is equally valid. 

We encounter nominal numbering systems all the time. Sports uniform 
numbers are nominal numbers. Ben Roethlisberger is identified on the foot- 
ball field by his jersey number. School bus numbers are nominal in that they 
simply identify a bus. Elementary school buses sometimes use both a number 
and an animal designation to help small children get on the right bus. So, 
bus number “8” may also be the “tiger” bus, but it could just as easily be the 
“horse” bus or the “cardinal” bus. 

The first drawing in Exhibit 13.4 depicts the number 7 on a horse’s col- 
ors. This is merely a label to allow bettors and racing enthusiasts to identify 


the horse. The assignment of a 7 to this horse does not mean that it is the 
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seventh fastest horse or that it is the seventh biggest, or anything else meaningful. But the 7 does 
let you know when you have won or lost your bet! 
In sum, nominal scale properties mean the numbering system simply identifies things. Exhibit 13.5 


lists some nominal scales commonly used by business researchers. 


EXHIBIT 13.4 
Nominal, Ordinal, Interval, 
and Ratio Scales Provide 


Different Information 7 
Nominal 


Show 


-AA 


Show 


Interval 


Ratio 


ordinal scales 


Ranking scales allowing things to 
be arranged based on how much 


— ae 


Place Win 


Place Win 


> 


20 Seconds 1.0 Second 


1 minute 59 % seconds for 1% miles 


of some concept they possess. Ordinal Scale 


Without nominal scales, 
how would you know which 
terminal to go to at this airport? 


m 
E 
Airways 
Aa canTransAir 


na 


arrivals on Terminal 5 
Aerolitoral T = 
ntinental Airlines 
A Jam aioa Copa A aia Copen piepe ; 
China Southern bel International United Express ry 
United Internatio 
ipari ramo are Omni” nt) Cas 
nman PSS Song Ter ia» 


Ordinal scales allow things to be arranged in order based on how much of some concept they 
possess. In other words, an ordinal scale is a ranking scale. In fact, we often use the term rank 


order to describe an ordinal scale. 
When class rank for high school 
students is determined, we have 
used an ordinal scale. We know 
that the student ranked seventh 
finished ahead of the student 
ranked eighth, who finished 
ahead of the ninth ranked stu- 
dent. However, we do not really 
know what the actual GPA was 
or how close these three students 
are to each other in overall grade 
point average. 

Research participants often 
are asked to rank things based 
on preference. So, preference 
is the concept, and the ordinal 
scale lists the options from most 
to least preferred, or vice versa. 
Five objects can be ranked from 
mpe ™ 1-5 (least preferred to most pre- 
J E e ferred) or 1—5 (most preferred to 
least preferred) with no loss of 
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Numerical 
Operations 


Descriptive 
Statistics 


Examples 


Nominal Student ID number Counting + Frequencies 
Yes - No + Mode 
Male - Female 
Buy - Did Not Buy 
East region 
Central region 
West region 
Ordinal Student class rank Counting + Frequencies 
Please rank your three favorite movies. Ordering + Mode 
Choose from the following: + Median 
+ Dissatisfied » Range 
+ Satisfied 
+ Very satisfied 
+ Delighted 
Indicate your level of education: 
+ Some high school 
+ High school diploma 
+ Some college 
+ College degree 
+ Graduate degree 
Interval Student grade point average (GPA) Common + Frequencies 
Temperature (Celsius and Fahrenheit) arithmetic - Mode 
Points given on an essay question operations + Median 
100-point job performance rating provided by supervisor » Range 
» Mean 
e Variance 
+ Standard deviation 
Ratio Amount spent on last purchase All + Frequencies 
Salesperson sales volume arithmetic + Mode 
Number of stores visited on a shopping trip operations + Median 
Annual family income + Range 
Time spent viewing a Web page + Mean 
e Variance 


+ Standard deviation 


meaning. In this sense, ordinal scales are somewhat arbitrary, but not nearly as arbitrary as a 
nominal scale. 

When business professors take some time off and go to the race track, even they know that 
a horse finishing in the “show” position has finished after the “win” and “place” horses (see the 
second drawing in Exhibit 13.4). The order of finish can be accurately represented by an ordinal 
scale using an ordered number rule: 


e Assign 1 to the “win” position 
e Assign 2 to the “place” position 
e Assign 3 to the “show” position 


Perhaps the winning horse defeated the place horse by a nose, but the place horse defeated 
the show horse by 20 seconds. The ordinal scale does not tell how far apart the horses were, but 
it is good enough to let someone know the result of a wager. Typical ordinal scales in business 
research ask respondents to rank their three favorite brands, have personnel managers rank poten- 
tial employees after job interviews, or judge investments as “buy,” “hold,” or “sell.” Researchers 
know how each item, person, or stock is judged relative to others, but they do not know by how 
much. 


Interval Scale 


Interval scales have both nominal and ordinal properties, but they also capture information about 
differences in quantities of a concept. So, not only would a sales manager know that a particular 
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Facts About 
the Four Levels of Scales 


interval scales 


Scales that have both nominal 
and ordinal properties, but that 
also capture information about 
differences in quantities of a 
concept from one observation to 
the next. 
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ratio scales 


Represent the highest form of 
measurement in that they have 
all the properties of interval 
scales with the additional attri- 
bute of representing absolute 
quantities; characterized by a 
meaningful absolute zero. 
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salesperson outperformed a colleague, information that would be available with an ordinal 
measure, but the manager would know by how much. If a professor assigns grades to term 
papers using a numbering system ranging from 1.0—20.0, not only does the scale represent the 
fact that a student with a 16.0 outperformed a student with 12.0, but the scale would show by 
how much (4.0). 

The third drawing in Exhibit 13.4 depicts a horse race in which the win horse is one second 
ahead of the place horse, which is 20 seconds ahead of the show horse. Not only are the horses 
identified by the order of finish, but the difference between each horse’s performance is known. 
So, horse number 7 and horse number 6 performed similarly (1 second apart), but horse number 
5 performed not nearly as well (20 seconds slower). 

The classic example of an interval scale is temperature. Consider the following weather: 


e June 6 was 80° F 
e December 7 was 40° F 


The interval Fahrenheit scale lets us know that December 7 was 40° F colder than June 6. But, 
we cannot conclude that December 7 was twice as cold as June 6. Although the actual numeral 
80 is indeed twice as great as 40, remember that this is a scaling system. In this case, the scale is 
not iconic, meaning that it does not exactly represent some phenomenon. In other words, there 
is no naturally occurring zero point—a temperature of 0° does not mean an absence of heat (or 
cold for that matter). 

Since temperature scales are interval, the gap between the numbers remains constant (i.e., the 
difference between 20° and 30° is 10°, just as the difference between 68° and 78° is 10°). This is 
an important element of interval scales and allows us to convert one scale to another. In this case, 
we can convert Fahrenheit temperatures to Celsius scale. Then, the following would result: 


e June 6 was 26.7° C 
e December 7 was 4.4° C 


Obviously, now we can see that December 7 was not twice as cold as June 6. December 7 was 
40° F or 22.3° C cooler, depending upon your thermometer. Interval scales are very useful 
because they capture relative quantities in the form of distances between observations. No matter 
what thermometer is used, December 7 was colder than June 6. 

Exhibit 13.5 provides some examples of interval level scales. 


Ratio Scale 


Ratio scales represent the highest form of measurement in that they have all the properties of inter- 
val scales with the additional attribute of representing absolute quantities. Interval scales possess 
only relative meaning, whereas ratio scales represent absolute meaning. In other words, ratio scales 
provide iconic measurement. 

Zero, therefore, has meaning in that it represents an absence of some concept. An absolute 
zero is the defining characteristic differentiating between ratio and interval scales. For example, 
money is a way to measure economic value. Consider the following items offered for sale in an 
online auction: 


e “Antique” 1970s digital watch—did not sell and there were no takers for free 
e Gold-filled Elgin wristwatch circa 1950—sold for $100 

e Vintage stainless steel Omega wristwatch—sold for $1,000 

e Antique rose gold Patek Philippe “Top Hat” wristwatch—sold for $9,000 


We can make the ordinal conclusions that the Patek was worth more than the Omega, and 
the Omega was worth more than the Elgin. All three of these were worth more than the 1970s 
digital watch. We can make interval conclusions such as that the Omega was worth $900 more 
than the Elgin. We can also conclude that the Patek was worth nine times as much as the Omega 
and that the 1970s watch was worthless (selling price = $0.00). The latter two conclusions are 
possible because price represents a ratio scale. 
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The fourth drawing in Exhibit 13.4 shows the time it took horse 7 to complete the race. If 
we know that horse 7 took 1 minute 59 2/5 seconds to finish the race, and we know the time it 
took for all the other horses, we can determine the time difference between horses 7, 6, and 5. 
In other words, if we knew the ratio information regarding the performance of each horse—the 
time to complete the race—we could determine the interval level information and the ordinal 
level information. However, if we only knew the ordinal level information, we could not create 
the interval or ratio information. Similarly, with only the interval level data we cannot create the 
ratio level information. 

Using our opening vignette as an example, Griff could decide to use a ratio measure— 
salesperson annual sales volume—as the indicator of performance for the CRM division. If he 
did this, he could create interval level data (groups of salespeople) or ordinal level data (the rank 
of each salesperson). However, this would be valid only if performance was truly equal to sales. 


Mathematical and Statistical Analysis of Scales 


While it is true that mathematical operations can be performed with numbers from nominal 
scales, the result may not have a great deal of meaning. For instance, a school district may per- 
form mathematical operations on the nominal school bus numbers. With this, they may find that 
the average school bus number is 77.7 with a standard deviation of 20.5. Will this help them use 
the buses more efficiently or better assign bus routes? Probably not. Can a professor judge the 
quality of her classes by the average ID number? While it could be calculated, the result is mean- 
ingless. Thus, although you can put numbers into formulas and perform calculations with almost 
any numbers, the researcher has to know the meaning behind the numbers before meaningful 
conclusions can be drawn.’ 


DISCRETE MEASURES 


Discrete measures are those that take on only one of a finite number of values. A discrete scale 
is most often used to represent a classification variable. Therefore, discrete scales do not repre- 
sent intensity of measures, only membership. Common discrete scales include any yes-or-no 
response, matching, color choices, or practically any scale that involves selecting from among 
a small number of categories. Thus, when someone is asked to choose from the following 
responses 


e Disagree 
e Neutral 
e Agree 


the result is a discrete value that can be coded 1, 2, or 3, respectively. This is also an ordinal scale 
to the extent that it represents an ordered arrangement of agreement. Nominal and ordinal scales 
are discrete measures. 

Certain statistics are most appropriate for discrete measures. Exhibit 13.5 shows statistics for 
each scale level. The largest distinction is between statistics used for discrete versus continuous 
measures. For instance, the central tendency of discrete measures is best captured by the mode. 
When a student wants to know what the most likely grade is for MGT 341, the mode will be very 
useful. Observe the results below from the previous semester: 


A 3 Students D 3 Students 
B 9 Students F 1 Student 


C 6 Students 


The mode is a “B” since more students obtained that value than any other value. Therefore, 
the “average” student would expect a B in MGT 341. 
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—William Thompson, 
Lord Kelvin 


discrete measures 


Measures that take on only one 
of a finite number of values. 
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Football Follies 
The subject of whether or not certain mathematical properties 
can be conducted with certain types of scales has been debated 
in the social science literature for decades. One famous statisti- 
cian used a funny parable about a football folly to make a point 
about this very well. The story goes something like this: 

A football coach purchased a vending machine that would 
assign numbers (0 to 99) to the school’s football players randomly. 
Over the years, then, all numbers should be equally used. By ran- 
domly assigning the numbers in this way, no players were treated 
unequally because no one could choose one of their favorite num- 
bers. Everybody simply got the number the machine spit out. 

Professor Aaron Urd, naturally curious about anything hav- 
ing to do with numbers, became suspicious that the football 
players had secretly been breaking into the machine to select 
more preferred numbers. Professor Urd believed that foot- 
ball had no place in college and would have loved to show 
how unscrupulous the football players really are—stealing 
numbers no less! However, Professor Urd had a problem. 
Football numbers are nominal numbers; all they do is identify! 
Therefore, as all good statisticians knew, you cannot compute 
averages with nominal numbers. In fact, all you can do is 
count nominal numbers. This problem tormented Professor 
Urd for years. He desperately wanted to test his hypothesis 
about the football number 
theft. Many times he entered 
the football numbers into a 
spreadsheet but could not 
bring himself to add, mul- 
tiply, or divide them. It just 
wouldn't be right! 


One fall, Aleck Smart, a star defensive 
tackle on the football team, wrote a term 
paper for Professor Aaron Urd entitled 
“A Statistical Treatment of the Football 
Team Numbering System.” Aleck, not 
being the brightest student, missed the day 

when Professor Urd taught students that you could not do 
arithmetic with nominal numbers. So, Aleck Smart computed 
all manner of statistics with data consisting of the last ten 
years of football numbers worn by the team. Among these, 
he showed that the average football number over those years 
was 40.1. Professor Aaron Urd was conflicted with this result. 
How can this be? If the numbers were assigned randomly, 
then shouldn't the average be 50? This must confirm his sus- 
picion about the football number theft. But even to think this 
troubled him because it meant his brain was unintentionally 
computing the average of nominal numbers! 

A few days later, Aleck dropped by Professor Aaron Urd’s 
office to pick up his paper (after office hours of course). 
Professor Urd lit into Aleck: “I have given you a failing grade, 
Mr. Smart. Numbers from football jerseys are nominal numbers! 
Don't you know that you cannot take the average of nominal 
numbers?” 

Aleck thought about that a while and answered, “Professor 
Urd, the numbers don’t know where they came from.” 

Professor Urd decided to change Aleck’s grade to a B-. He 
then used Aleck’s calculations to try and show the faculty senate 
that the football team was indeed breaking into the machine. 
Sources: Lord, F. M., “On the Statistical Treatment of Football Numbers,” American 


Psychologist 8 (1953), 750-751; Cohen, Jacob, “Things | Have Learned (So Far),” 
American Psychologist 45 (December 1990), 1304-1312. 


CONTINUOUS MEASURES 


continuous measures 


Measures that reflect the inten- 
sity of a concept by assigning 
values that can take on any value 
along some scale range. 
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Continuous measures are those assigning values anywhere along some scale range in a place that 
corresponds to the intensity of some concept. Ratio measures are continuous measures. Thus, 
when Griff measures sales for each salesperson using the dollar amount sold, he is assigning a con- 
tinuous measure. A number line could be constructed ranging from the least amount sold to the 
most, and a spot on the line would correspond exactly to a salesperson’s performance. 

Strictly speaking, interval scales are not necessarily continuous. Consider the following com- 
mon type of survey question: 


Strongly Disagree Disagree Neutral Agree Strongly Agree 


| enjoy participating 1 J 3 4 5 
in online auctions 


This is a discrete scale because only the values 1, 2, 3, 4, or 5 can be assigned. Furthermore, it is an 
ordinal scale because it only orders based on agreement. We really have no way of knowing that 
the difference in agreement of somebody marking a 5 instead of a 4 is the same as the difference 
in agreement of somebody marking a 2 instead of a 1. Therefore, the mean is not an appropriate 
way of stating central tendency and, technically, we really shouldn’t use many common statistics 
on these responses. 
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However, as a scaled response of this type takes on more values, the error introduced by 
assuming that the differences between the discrete points are equal becomes smaller. This may be 
seen by imagining a Likert scale (the traditional business research agreement scale shown above) 
with a thousand levels of agreement rather than three. The differences between the different levels 
become so small with a thousand levels that only tiny errors could be introduced by assuming each 
interval is the same. Therefore, business researchers generally treat interval scales containing five or 
more categories of response as interval. When fewer than five categories are used, this assumption 
is Inappropriate. 

The researcher should keep in mind, however, the distinction between ratio and interval mea- 
sures. Errors in judgment can be made when interval measures are treated as ratio. For example, 
attitude is usually measured with an interval scale. An attitude of zero means nothing. In fact, 
attitude would only have meaning in a relative sense. In other words, attitude takes on meaning 
when one person’s response is compared to another or through some other comparison. A single 
attitude score alone contains little useful information. 

The mean and standard deviation may be calculated from continuous data. Using the actual 
quantities for arithmetic operations is permissible with ratio scales. Thus, the ratios of scale values 
are meaningful. A ratio scale has all the properties of nominal, ordinal, and interval scales. How- 
ever, the same cannot be said in reverse. An interval scale, for example, has ordinal and nominal 
properties, but it does not have ratio properties (see Exhibit 13.5). 

Chapters 19 through 23 further explore the limitations scales impose on the mathematical 
analysis of data. 


Index Measures 


Earlier, we distinguished constructs as concepts that require multiple variables to measure them 
adequately. Looking back to the chapter vignette, could it be that multiple items will be required 
to adequately represent job performance? Likewise, a consumer’s attitude toward some product 
is usually a function of multiple attributes. An attribute is a single characteristic or fundamental 
feature of an object, person, situation, or issue. 


Indexes and Composites 


Multi-item instruments for measuring a construct are called index measures, or composite measures. 
An index measure assigns a value based on how much of the concept being measured is associated 
with an observation. Indexes often are formed by putting several variables together. For example, 
a social class index might be based on three weighted variables: occupation, education, and area of 
residence. Usually, occupation is seen as the single best indicator and would be weighted highest. 
With an index, the different attributes may not be strongly correlated with each other. A person’s 
education does not always relate strongly to their area of residence. The American Consumer 
Satisfaction Index shows how satisfied American consumers are based on an index of satisfaction 
scores. Readers are likely not surprised to know that Americans appear more satisfied with soft 
drinks than they are with cable TV companies based on this index.® 

Composite measures also assign a value based on a mathematical derivation of multiple vari- 
ables. For example, salesperson satisfaction may be measured by combining questions such as 
“How satisfied are you with your job? How satisfied are you with your territory? How satisfied are 
you with the opportunity your job offers?” For most practical applications, composite measures 
and indexes are computed in the same way.’ 


Computing Scale Values 


Exhibit 13.6 on the next page demonstrates how a composite measure can be created from 
common rating scales. This scale was developed to assess how much a consumer trusts a Web 
site. This particular composite represents a summated scale. A summated scale is created by 
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attribute 


A single characteristic or fun- 
damental feature of an object, 
person, situation, or issue. 


index measure 


An index assigns a value based 
on how much of the concept 
being measured is associated 
with an observation. Indexes 
often are formed by putting sev- 
eral variables together. 


composite measures 


Assign a value to an observation 
based on a mathematical deriva- 
tion of multiple variables. 


summated scale 


A scale created by simply sum- 
ming (adding together) the 
response to each item making up 
the composite measure. 
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XHIBIT 13.6 
Computing a Composite 
Scale 


reverse coding 


Means that the value assigned for 
a response is treated oppositely 
from the other items. 


Part 4: Measurement Concepts 


simply summing the response to each item making up the composite measure. For this scale, 
a respondent that judged the Web site as extremely trustworthy would choose SA (value of 5) 
for each question. Across the five questions, this respondent’s score would be 25. Con- 
versely, a respondent that thought the Web site was very untrustworthy would chose SD 
(value of 1) for each question; a total of 5. Most respondents would likely be somewhere 
between these extremes. For the example respondent in Exhibit 13.6, the summated scale 
score would be 13 based on his responses to the five items (2 +3 +2 +2 +4= 13).A 
researcher may sometimes choose to average the scores rather than summing them. The 
advantage to this is that the composite measure is expressed on the same scale (1—5 rather 
than 5—25) as the original items. So, instead of a 13, the consumer would have a score of 2.6. 
While this approach might be more easily understood, the information contained in either 
situation (13 versus 2.6) is the same. 


Item Strongly Disagree (SD) — Strongly Agree (SA) 


This site appears to be more trustworthy than other SD ©) N A SA 
sites | have visited. 

My overall trust in this site is very high. SD D N) A SA 
My overall impression of the believability of the SD ©) N A SA 
information on this site is very high. 

My overall confidence in the recommendations SD ©) N A SA 
on this site is very high. 

The company represented in this site delivers on its SD D N A) SA 


promises. 


Computation: 
Scale Values: SD = 1,D = 2,N=3,A=4,SA=5 


Thus, the Trust score for this consumer is 
2+3+2+2+4=13 


Sometimes, a response may need to be reverse-coded before computing a summated or 
averaged scale value. Reverse coding means that the value assigned for a response is treated oppo- 
sitely from the other items. If a sixth item was included on the Web site trust scale that said, 
“I do not trust this Web site,” reverse coding would be necessary to make sure the composite 
made sense. For example, the respondent that judged the Web site is extremely trustworthy 
would choose SA for the first five items, then SD for the sixth. We can see that we would not 
want to just add these up, as this score of 21 would not really reflect someone that felt very 
positive about the trustworthiness of the site. Since the content of the sixth item is the reverse 
of trust (distrust), so the scale itself should be reversed. Thus, on a 5-point scale, the values are 
reversed as follows: 


e 5 becomes 1 
e 4 becomes 2 
e 3 stays 3 

e 2 becomes 4 
e 1 becomes 5 


After the reverse coding, our respondent that felt the Web site was trustworthy would have a sum- 
mated score of 25, which does correctly reflect a very positive attitude. If the respondent described 
in Exhibit 13.6 responded to this new item with a SA (5), it would be reverse coded as a 1 before 
computing the summated scale. Thus, the summated scale value for the six items would become 
14. The process of reverse coding is discussed in the Research Snapshot on the next page titled 
“Recoding Made Easy.” 


4 *LaJolla.say [DataSet1] - SPSS Data Editor 
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A Recoding Made Easy 
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This process would suc- 
cessfully recode a variable 
that needed to be reverse 
coded. 
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Three Criteria for Good Measurement 


The three major criteria for evaluating measurements are reliability, validity, and sensitivity. 


Reliability 


Reliability is an indicator of a measure’s internal consistency. Consistency is the key to understand- reliability 


ing reliability. A measure is reliable when different attempts at measuring something converge on An indicator of a measure’s inter- 
the same result. For example, consider an exam that has three parts: 25 multiple-choice questions, nal consistency. 
2 essay questions, and a short case. Ifa student gets 20 of the 25 (80 percent) multiple-choice ques- 
tions correct, we would expect she would also score about 80 percent on the essay and case por- 
tions of the exam. Further, if a professor’s research tests are reliable, a student should tend toward 
consistent scores on all tests. In other words, a student who makes an 80 percent on the first test 
should make scores close to 80 percent on all subsequent tests. Another way to look at this is that 
the student who makes the best score on one test will exhibit scores close to the best score in the 
class on the other tests. If it is difficult to predict what students would make on a test by examining 
their previous test scores, the tests probably lack reliability or the students are not preparing the 
same each time. 
So, the concept of reliability revolves around consistency. Think of a scale to measure 
weight. You would expect this scale to be consistent from one time to the next. If you stepped 
on the scale and it read 140 pounds, then got off and back on, you would expect it to again 
read 140. If it read 110 the second time, while you may be happier, the scale would not 
be reliable. 
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internal consistency 


Represents a measure’s homoge- 
neity or the extent to which each 
indicator of a concept converges 

on some common meaning. 


split-half method 


A method for assessing internal 
consistency by checking the 
results of one-half of a set of 

scaled items against the results 

from the other half. 


coefficient alpha (a) 


The most commonly applied 
estimate of a multiple-item 
scale’s reliability. It represents the 
average of all possible split-half 
reliabilities for a construct. 


test-retest method 


Administering the same scale 
or measure to the same respon- 
dents at two separate points in 
time to test for stability. 
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INTERNAL CONSISTENCY 


Internal consistency represents a measure’s homogeneity. An attempt to measure trustworthiness 
may require asking several similar but not identical questions, as shown in Exhibit 13.6. The set 
of items that make up a measure are referred to as a battery of scale items. Internal consistency of a 
multiple-item measure can be measured by correlating scores on subsets of items making up a 
scale. 

The split-half method of checking reliability is performed by taking half the items from a scale 
(for example, odd-numbered items) and checking them against the results from the other half 
(even-numbered items). The two scale halves should produce similar scores and correlate highly. 
The problem with split-half method is determining the two halves. Should it be even- and odd- 
numbered questions? Questions 1—3 compared to 4—6? Coefficient alpha provides a solution to 
this dilemma. 

Coefficient alpha (a) is the most commonly applied estimate of a multiple-item scale’s reli- 
ability.’ Coefficient a represents internal consistency by computing the average of all possible 
split-half reliabilities for a multiple-item scale. The coefficient demonstrates whether or not the 
different items converge. Although coefficient a does not address validity, many researchers use 
a as the sole indicator of a scale’s quality. Coefficient alpha ranges in value from 0, meaning no 
consistency, to 1, meaning complete consistency (all items yield corresponding values). Generally 
speaking, scales with a coefficient a between 0.80 and 0.95 are considered to have very good reli- 
ability. Scales with a coefficient a between 0.70 and 0.80 are considered to have good reliability, 
and an a value between 0.60 and 0.70 indicates fair reliability. When the coefficient a is below 
0.6, the scale has poor reliability." 
compute coefficient a. 


Most statistical software packages, such as SPSS, will easily 


TEST-RETEST RELIABILITY 


The test-retest method of determining reliability involves administering the same scale or measure 
to the same respondents at two separate times to test for stability. If the measure is stable over time, 
the test, administered under the same conditions each time, should obtain similar results. Test- 
retest reliability represents a measure’s repeatability. 

Suppose a researcher at one time attempts to measure buying intentions and finds that 12 per- 
cent of the population is willing to purchase a product. If the study is repeated a few weeks later 
under similar conditions, and the researcher again finds that 12 percent of the population is willing 
to purchase the product, the measure appears to be reliable. High stability correlation or consis- 
tency between two measures at time 1 and time 2 indicates high reliability. 

Let’s assume that a person does not change his or her attitude about dark beer. Attitude might 
be measured with an item like the one shown below: 


I prefer dark beer to all other types of beer. 


If repeated measurements of that individual’s attitude toward dark beer are taken with the 
same scale, a reliable instrument will produce the same results each time the scale is measured. 
Thus one’s attitude in October of 2009 should tend to be the same as one’s attitude in May 2010. 
When a measuring instrument produces unpredictable results from one testing to the next, the 
results are said to be unreliable because of error in measurement. 

As another example, consider these remarks by a Gillette executive made about the reliability 
problems in measuring reactions to razor blades: 


There is a high degree of noise in our data, a considerable variability in results. It’s a big mish-mash, what 
we call the night sky in August. There are points all over the place. A man will give a blade a high score 
one day, but the next day he’ll cut himself a lot and give the blade a terrible score. But on the third day, 
he’ll give the same blade a good score. What you have to do is try to see some pattern in all this. There 
are some gaps in our knowledge."' 


Measures of test-retest reliability pose two problems that are common to all longitudinal stud- 
ies. First, the pre-measure, or first measure, may sensitize the respondents to their participation in 
a research project and subsequently influence the results of the second measure (you may recall 
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we referred to this as “demand characteristics” in Chapter 12). Furthermore, if the time between 
measures is long, there may be an attitude change or other maturation of the subjects. Thus, a 
reliable measure can indicate a low or a moderate correlation between the first and second admin- 
istration, but this low correlation may be due to an attitude change over time rather than to a lack 
of reliability in the measure itself. 


Validity 


Good measures should be both consistent and accurate. Reliability represents how consistent a 
measure is, in that the different attempts at measuring the same thing converge on the same point. 
Accuracy deals more with how a measure assesses the intended concept. Validity is the accuracy of 
a measure or the extent to which a score truthfully represents a concept. In other words, are we 
accurately measuring what we think we are measuring? 

Achieving validity is not a simple matter. The opening vignette describes this point. The job 
performance measure should truly reflect job performance. If a supervisor’s friendship affects the 
performance measure, then the scale’s validity is diminished. Likewise, if the performance scale is 
defined as effort, the result may well be a reliable scale but not one that actually reflects perfor- 
mance. Effort may well lead to performance but effort probably does not equal performance. 

Students should be able to empathize with the following validity problem. Consider the con- 
troversy about highway patrol officers using radar guns to clock speeders. A driver is clocked at 
83 mph in a 55 mph zone, but the same radar gun aimed at a house registers 28 mph. The error 
occurred because the radar gun had picked up impulses from the electrical system of the squad 
car’s idling engine. Obviously, the house was not moving, thus how can we be sure the car was 
speeding? In this case, we would certainly question if the accusation that the car was actually going 
83 mph is completely valid. 


ESTABLISHING VALIDITY 


Researchers have attempted to assess validity in many ways. They attempt to provide some evi- 
dence of a measure’s degree of validity by answering a variety of questions. Is there a consensus 
among other researchers that my attitude scale measures what it is supposed to measure? Does my 
measure cover everything that it should? Does my measure correlate with other measures of the 
same concept? Does the behavior expected from my measure predict actual observed behavior? 
The four basic approaches to establishing validity are face validity, content validity, criterion validity, 
and construct validity. 

Face validity refers to the subjective agreement among professionals that a scale logically reflects 
the concept being measured. Do the test items look like they make sense given a concept’s defini- 
tion? When an inspection of the test items convinces experts that the items match the definition, 
the scale is said to have face validity. 

Clear, understandable questions such as “How many children do you have?” generally are 
agreed to have face validity. But it becomes more difficult to assess face validity in regard to more 
complicated business phenomena. For instance, consider the concept of customer loyalty. Does the 
statement “I prefer to purchase my groceries at Delavan Fine Foods” appear to capture loyalty? 
How about “I am very satisfied with my purchases from Delavan Fine Foods”? What about 
“Delavan Fine Foods offers very good value”? While the first statement appears to capture loyalty, 
it can be argued the second question is not loyalty but rather satisfaction. What does the third 
statement reflect? Do you think it looks like a loyalty statement? 

In scientific studies, face validity might be considered a first hurdle. In comparison to other 
forms of validity, face validity is relatively easy to assess. However, researchers are generally not 
satisfied with simply establishing face validity. Because of the elusive nature of attitudes and other 
business phenomena, additional forms of validity are sought. 

Content validity refers to the degree that a measure covers the domain of interest. Do the items 
capture the entire scope, but not go beyond, the concept we are measuring? If an exam is sup- 
posed to cover chapters 1—5, it is fair for students to expect that questions should come from all 
five chapters, rather than just one or two. It is also fair to assume that the questions will not come 
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validity 


The accuracy of a measure or the 
extent to which a score truthfully 
represents a concept. 


face validity 


A scale’s content logically 
appears to reflect what was 
intended to be measured. 


content validity 


The degree that a measure covers 
the breadth of the domain of 
interest. 
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from chapter 6. Thus, when students com- 
plain about the material on an exam, they 
are often claiming it lacks content validity. 
Similarly, an evaluation of an employee’s 
job performance should cover all important 
aspects of the job, but not something out- 
side of the employee’s specified duties. 

It has been argued that shoppers receive 
value from two primary elements.'? Hedo- 
nic shopping value refers to the pleasure 
and enjoyment one gets from the shop- 
ping experience, while utilitarian shop- 
ping value refers to value received from the 
actual acquisition of the product desired. If 
a researcher assessing shopping value only 
asked questions regarding the utilitarian 
aspects of shopping, we could argue the 
measure lacks content validity since part of 
the domain peroni value) is ignored. 


Cc y addresses the ques- 
tion, “How well does my measure work in 
practice?” Because of this, criterion validity 
is sometimes referred to as pragmatic valid- 
ity. In other words, is my measure practi- 
cal? Criterion validity may be classified as 
either concurrent validity or predictive validity 
depending on the time sequence in which 


the new measurement scale and the cri- 
A golfer can hit reliable but not 
valid putts. This fellow misses 
all his putts to the left. 


terion measure are correlated. If the new 
measure is taken at the same time as the criterion measure and is shown to be valid, then it has 
concurrent validity. Predictive validity is established when a new measure predicts a future event. 


lidity The two measures differ only on the basis of a time dimension—that is, the criterion measure is 
The ability of ameasure to separated in time from the predictor measure. 


correlate with other standard For instance, a home pregnancy test is designed to have concurrent validity—to accurately 
measures of similar constructs or 


determine if a person is pregnant at the time of the test. Fertility tests, on the other hand, are 


established criteria. 


designed for predictive validity—to determine if a person can become pregnant in the future. In a 
business setting, participants in a training seminar might be given a test to assess their knowledge 
of the concepts covered, establishing concurrent validity. Personnel managers may give potential 
uct employees an exam to predict if they will be effective salespeople (predictive validity). While face 
Exists when a measure reliably van isa vee evaluation, criterion validity provides a more rigorous empirical test. 

C exists when a measure reliably measures and truthfully represents a unique 


measures and truthfully repre- 


sents a unique concept; consists concept. Construct validity consists of several components, including 
of several components including 


face validity, content validty, cri- ° Face validity 
terion validity, convergent valid- e Content validity 
ity, and discriminant validity. e Criterion validity 


e Convergent validity 


e Discriminant validity 


Concepts that should be related 


to one another are in fact related; We have discussed face validity, content validity, and criterion validity. Before we move further, 
highly reliable scales contain 


convergent validity. 


we must be sure our measures look like they are measuring what they are intended to measure 
ans validity) and adequately c cover the domain of interest (content validity). If so, we can assess 
y and d ant validity 


Represents how unique or dis- These forms of validity mih ior unique or distinct a measure is. Convergent validity 
tinct is a measure; a scale should requires that concepts that should be related are indeed related. For example, in business we 
not correlate too highly witha believe customer satisfaction and customer loyalty are related. If we have measures of both, we 


re of a different truct. ae SO ; 
measure OF a GHTSTENE construc would expect them to be positively correlated. If we found no significant correlation between our 
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measures of satisfaction and our measures of loyalty, it would bring into question the convergent 
validity of these measures. On the other hand, our customer satisfaction measure should not cor- 
relate too highly with the loyalty measure if the two concepts are truly different. If the correlation 
is too high, we have to ask if we are measuring two different things, or if satisfaction and loyalty 
are actually one concept. As a rough rule of thumb, when two scales are correlated above 0.75, 
discriminant validity may be questioned. So, we expect related concepts to display a significant 
correlation (convergent validity), but not to be so highly correlated that they are not independent 
concepts (discriminant validity). 

Multivariate procedures like factor analysis can be useful in establishing construct validity. The 
reader is referred to other sources for a more detailed discussion." 


Reliability versus Validity 


Reliability is a necessary but not sufficient condition for validity. A reliable scale may not be 
valid. For example, a purchase intention measurement technique may consistently indicate that 
20 percent of those sampled are willing to purchase a new product. Whether the measure is valid 
depends on whether 20 percent of the population indeed purchases the product. A reliable but 
invalid instrument will yield consistently inaccurate results. 

The differences between reliability and validity can be illustrated by the rifle targets in 
Exhibit 13.7. Suppose an expert sharpshooter fires an equal number of rounds with a century-old 
rifle and a modern rifle.'* The shots from the older gun are considerably scattered, but those from the 
newer gun are closely clustered. The variability of the old rifle compared with that of the new one 
indicates it is less reliable. The target on the right illustrates the concept of a systematic bias influenc- 
ing validity. The new rifle is reliable (because it has little variance), but the sharpshooter’s vision is 
hampered by glare. Although shots are consistent, the sharpshooter is unable to hit the bull’s-eye. 


Old Rifle New Rifle New Rifle Sunglare 
Low Reliability High Reliability Reliable but not Valid 
(Target A) (Target B) (Target C) 
Sensitivity 


The sensitivity of a scale is an important measurement concept, particularly when changes in atti- 
tudes or other hypothetical constructs are under investigation. Sensitivity refers to an instrument’s 
ability to accurately measure variability in a concept. A dichotomous response category, such as 
“agree or disagree,” does not allow the recording of subtle attitude changes. A more sensitive 
measure with numerous categories on the scale may be needed. For example, adding “strongly 
agree,” “mildly agree,” “neither agree nor disagree,” “mildly disagree,” and “strongly disagree” 
will increase the scale’s sensitivity. 

The sensitivity of a scale based on a single question or single item can also be increased by 
adding questions or items. In other words, because composite measures allow for a greater range 
of possible scores, they are more sensitive than single-item scales. Thus, sensitivity is generally 
increased by adding more response points or adding scale items. 
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EXHIBIT 13.7 
Reliability and Validity 
on Target 


sensitivity 


A measurement instrument's 
ability to accurately measure vari- 
ability in stimuli or responses. 


A 
m 


When determining which level of scale measurement to use, 

a researcher is usually best served by collecting the highest 

quality of data possible. If you have ratio level data, you can 

create interval or ordinal level data. For instance, if you col- 
lect the actual sales figures for each salesperson, the rank 

(ordinal) of each salesperson can be determined, or interval 

level categories can be established. You cannot move the 

other direction. However, there are exceptions to this rule. 

e First, when you anticipate that ranking will result in 
greater variance than rating the items independently, it 
might be better to collect ordinal data rather than inter- 
val. For example, if an employee is asked rate the impor- 
tance of (1) salary, (2) opportunities for advancement, and 
(3) enjoyable work environment on a five-point interval 
scale, he could very well give a 5 to each. If asked to rank 
these three, the respondent could likely assign them a 1, 
2, and 3, which would provide greater variance and more 
information. 

e A second situation involves sensitive information. While 
we could collect ratio level data regarding annual income 


interval level data by creating mul- 
tiple ranges as this is not as intrusive 
to the respondent. 

We can think of internal consistency of ask- 

ing multiple questions at one point in time to 

assess reliability; we can think of test-retest of 

asking the same question(s) to the same respondents at dif- 

ferent points in time. Since we typically prefer to collect data 

once instead of twice, internal consistency is the most com- 
mon method of establishing reliability in business research. 

Reliability is necessary, but not sufficient, to establish valid- 

ity. A measure can be reliable, but not valid. However, a valid 

measure is reliable. Since validity is our true goal, why do we 
even deal with validity? 

e The issue here revolves around our ability to establish reli- 
ability and validity. Reliability is relatively easy to assess, 
while validity is much more difficult. In fact, it is fair to 
say we can never unequivocally establish validity; valid- 
ity must be inferred. So, if our measure is not reliable, we 
have no reason to try the more difficult task of establish- 
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by asking for an actual number, we typically collect ing validity. 


Summary 


1.Determinewhatneeds to be measured toaddressaresearch question orhypothesis. Researchers 
can determine what concepts must be measured by examining research questions and hypotheses. 
A hypothesis often states that one concept is related to another. Therefore, the concepts listed in 
the hypotheses must have operational measures if the research is to be performed. 


2. Distinguish levels of scale measurement. Four levels of scale measurement can be identified. 
Each level is associated with increasingly more complex properties. Nominal scales assign num- 
bers or letters to objects for identification or classification. Ordinal scales arrange objects based 
on relative magnitude of a concept. Thus, ordinal scales represent rankings. Interval scales also 
represent an ordering based on relative amounts of a concept, but they also capture the differences 
between scale values. Thus, interval scales allow stimuli to be compared to each other based on 
the difference in their scale scores. Ratio scales are absolute scales, starting with absolute zeros at 
which there is a total absence of the attribute. Nominal and ordinal scales are discrete. The mode 
is the best way to represent central tendency for discrete measures. Ratio measures are continu- 
ous and interval scales are generally treated as continuous. For continuous measures, the mean 
represents a valid representation of central tendency. 


3. Know how to form an index or composite measure. Indexes and composite measures are formed 
by combining scores from multiple items. For instance, a composite score can be formed by add- 
ing the scores to multiple items, each intended to represent the same concept. 


4. List the three criteria for good measurement. Good measurement exists when a measure is 
reliable, valid, and sensitive. Thus, reliability, validity, and sensitivity are characteristics of good 
measurement. Reliability represents the consistency and repeatability of a measure. Validity refers 
to the degree to which the instrument measures the concept the researcher wants to measure. 
Sensitivity is the instrument’s ability to accurately measure variability in stimuli or responses. 


5. Provide a basic assessment of scale reliability and validity. Reliability is most often assessed 
using coefficient alpha. Coefficient alpha should be at least 0.6 for a scale to be considered as 
acceptably reliable. Validity is assessed in components. A measure that has adequate construct 
validity is one that is likely to be well measured. Construct validity consists of face validity, con- 
tent validity, criterion validity, convergent validity, and discriminant validity. Statistical proce- 
dures like factor analysis can be helpful in providing evidence of construct validity. 
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Key Terms and Concepts 


attribute, 303 

coefficient alpha («), 306 
composite measures, 303 
concept, 295 

construct, 296 

construct validity, 308 
content validity, 307 
continuous measures, 302 
convergent validity, 308 
correspondence rules, 295 


criterion validity, 308 
discrete measures, 301 
discriminant validity, 308 
face validity, 307 

index measure, 303 
internal consistency, 306 
interval scales, 299 
measurement, 293 
nominal scales, 297 
operationalization, 295 


ordinal scales, 298 
ratio scales, 300 
reliability, 305 

reverse coding, 304 
scales, 295 

sensitivity, 309 
split-half method, 306 
summated scale, 303 
test-retest method, 306 
validity, 307 


Questions for Review and Critical Thinking 


Define measurement. How is your performance in your research 
class being measured? 

What is the difference between a concept and a construct? 
Suppose a researcher takes over a project only after a pro- 

posal has been written by another researcher. Where will the 
researcher find the things that need to be measured? 

Describe, compare, and contrast the four different levels of scale 
measurement. 

Consider the different grading measuring scales described at the 
beginning of the chapter. Describe what level of measurement 
is represented by each. Which method do you think contains 
the least opportunity for error? 

Look at the responses to the following survey items that 
describe how stressful consumers believed a Christmas shopping 
trip was using a ten-point scale ranging from 1 (= no stress at 
all) to 10 (= extremely stressful): 

How stressful was finding a place to park? 7 

How stressful was the checkout procedure? 5 

How stressful was trying to find exactly the right product? 8 
How stressful was finding a store employee? 6 


aaor 


i. What would be the stress score for this respondent 
based on a summated scale score? 
ii. What would be the stress score for this respondent 
based on an average composite scale score? 
ii. Do any items need to be reverse-coded? Why or why 
not? 
How is it that business researchers can justify treating a seven- 
point Likert scale as interval? 


8. 
9. 


10. 


11. 


12. 


What are the components of construct validity? Describe each. 
Why might a researcher wish to use more than one question to 
measure satisfaction with a particular aspect of retail shopping? 
How can a researcher assess the reliability and validity of a 
multi-item composite scale? 

Comment on the validity and reliability of the following: 

a. A respondent’s report of an intention to subscribe to 
Consumer Reports is highly reliable. A researcher believes 
this constitutes a valid measurement of dissatisfaction with 
the economic system and alienation from big business. 

b. A general-interest magazine claimed that it was a better 
advertising medium than television programs with similar 
content. Research had indicated that for a soft drink and 
other test products, recall scores were higher for the maga- 
zine ads than for 30-second commercials. 

c. A respondent’s report of frequency of magazine 
reading consistently indicates that she regularly reads 
Good Housekeeping and Gourmet and never reads 
Cosmopolitan. 

Indicate whether the following measures use a nominal, ordinal, 

interval, or ratio scale: 

a. Prices on the stock market 

b. Marital status, classified as “married” or “never married” 

c. A yes/no question asking whether a respondent has ever 
been unemployed 

d. Professorial rank: assistant professor, associate professor, or 
professor 

e. Grades: A, B, C, D, or F 


Research Activities 


Go to the library and find out how Sales and Marketing 
Management magazine constructs its buying-power index. 
Define each of the following concepts, and then operationally 
define each one by providing correspondence rules between the 
definition and the scale: 

a. A good bowler 

The television audience for The Tonight Show 

Purchasing intention for an iPhone 

Consumer involvement with cars 

A workaholic 


sao 


f. Outstanding supervisory skills 

g. A risk averse investor 

‘NET Use the ACSI scores found at http://www.theacsi.org to 

respond to this question. Using the most recent two years of 

data, test the following two hypotheses: 

a. American consumers are more satisfied with breweries than 
they are with wireless telephone services. 

b. ‘NET American consumers are more satisfied with discount 
and department stores than they are with automobile 
companies. 
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4. Refer back to the opening vignette. Use a search engine to 
find stories dealing with job performance. In particular, pay 
attention to stories that may be related to CRM. Make a rec- 
ommendation to Griff concerning a way that job performance 
should be measured. Would your scale be nominal, ordinal, 
interval, or ratio? 


Part 4: Measurement Concepts 


5. ‘NET Go to http://www.queendom.com/tests. Click on the lists of 
personality tests. Take the hostility test. Do you think this is a 
reliable and valid measure of how prone someone is to generally 
act in a hostile manner? 


Case 13.1 FlyAway Airways 
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Wesley Shocker, research analyst for FlyAway 
Airways, was asked by the director of research 

to make recommendations regarding the best 
approach for monitoring the quality of service 
provided by the airline. FlyAway Airways is a 
national air carrier that has a comprehensive route 
structure consisting of long-haul, coast-to-coast routes and direct, non- 
stop routes between short-haul metropolitan areas. Current competi- 
tors include Midway and Alaska Airlines. FlyAway Airlines is poised 
to surpass the billion-dollar revenue level required to be designated as 
a major airline. This change in status brings a new set of competitors. 
To prepare for this move up in competitive status, Shocker was asked 
to review the options available for monitoring the quality of FlyAway 
Airways service and the service of its competitors. Such monitoring 
would involve better understanding the nature of service quality and 
the ways in which quality can be tracked for airlines. 

After some investigation, Shocker discovered two basic 
approaches to measuring quality of airline service that can produce 
similar ranking results. His report must outline the important aspects 
to consider in measuring quality as well as the critical points of differ- 
ence and similarity between the two approaches to measuring quality. 


Some Background on Quality 


In today’s competitive airline industry, it’s crucial that an airline do 
all it can do to attract and retain customers. One of the best ways 

to do this is by offering quality service to consumers. Perceptions of 
service quality vary from person to person, but an enduring element 
of service quality is the consistent achievement of customer satisfac- 
tion. For customers to perceive an airline as offering quality service, 
they must be satisfied, and that usually means receiving a service 
outcome that is equal to or greater than what they expected. 

An airline consumer usually is concerned most with issues of 
schedule, destination, and price when choosing an airline. Given 
that most airlines have competition in each of these areas, other fac- 
tors that relate to quality become important to the customer when 
making a choice between airlines. Both subjective aspects of qual- 
ity (that is, food, pleasant employees, and so forth) and objective 
aspects (that is, on-time performance, safety, lost baggage, and so 
forth) have real meaning to consumers. These secondary factors may 
not be as critical as schedule, destination, and price, but they do 
affect quality judgments of the customer. 

There are many possible combinations of subjective and objec- 
tive aspects that could influence a customer’s perception of quality 
at different times. Fortunately, since 1988, consumers of airline ser- 
vices have had access to objective information from the Department 
of Transportation regarding service performance in some basic 


categories. Unfortunately, the average consumer is most likely 
unaware of or uninterested in these data on performance; instead, 
consumers rely on personal experience and subjective opinion to 
judge quality of service. Periodic surveys of subjective consumer 
opinion regarding airline service experience are available through 
several sources. These efforts rely on contact with a sample of con- 
sumers who may or may not have informed opinions regarding the 
quality of airline service for all airlines being compared. 


A Consumer Survey Approach 


In his research, Shocker discovered a recent study conducted to 
identify favorite airlines of frequent fliers. This study is typical 
of the survey-based, infrequent (usually only annually), subjec- 
tive efforts conducted to assess airline quality. A New York 
firm, Research & Forecasts, Inc., published results of a consumer 
survey of frequent fliers that used several criteria to rate domes- 
tic and international airlines. Criteria included comfort, service, 
reliability, food quality, cost, delays, routes served, safety, and 
frequent-flier plans. The questionnaire was sent to 25,000 fre- 
quent fliers. 

The 4,462 people who responded were characterized as pre- 
dominantly male (59 percent) professional managers (66 percent) 
whose average age was 45 and who traveled an average of at least 
43 nights a year for both business and pleasure. This group indi- 
cated that the most important factors in choosing an airline were 
1) route structure (46 percent), 2) price (42 percent), 3) reliability 
(41 percent), 4) service (33 percent), 5) safety (33 percent), 

6) frequent-flier plans (33 percent), and 7) food (12 percent). 
When asked to rate twenty different airlines, respondents provided 
the rankings in Case Exhibit 13.1-1. 


Ranking of Major Airlines: Consumer 


Survey Approach 
1. American 11. Lufthansa 
2. United 12. USAir 
3. Delta 13. KLM 
4. TWA 14. America West 
5. SwissAir 15. JAL 
6. Singapore 16. Alaska 
7. British Airways 17. Qantas 
8. Continental 18. Midway 
9. Air France 19. Southwest 
10. Pan Am 20. SAS 


Chapter 13: Measurement and Scaling Concepts 


A Weighted Average Approach 


Shocker also discovered a newer, more objective approach to mea- 
suring airline quality in a study recently published by the National 
Institute for Aviation Research at the Wichita State University in 

Wichita, Kansas. The Airline Quality Rating (AQR) is a weighted 


average of 19 factors that have relevance when judging the quality of 


airline services (see Case Exhibit 13.2—2). The AQR is based on data 
that are readily obtainable (most of the data are updated monthly) 


from published sources for each major airline operating in the United 


States. Regularly published data on such factors as consumer com- 


plaints, on-time performance, accidents, number of aircraft, and finan- 
cial performance are available from the Department of Transportation, 


the National Transportation Safety Board, Moody’s Bond Record, 
industry trade publications, and annual reports of individual airlines. 


Factors Included in the Airline Quality 
Rating (AQR)? 


Factor Weight 
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using a scale of 0 (no importance) to 10 (great importance). The 


aver 


age importance ratings for each of the 19 factors were then used 


as the weights for those factors in the AQR. Case Exhibit 13.1—2 
shows the factors included in the Airline Quality Rating, the weight 
associated with each factor, and whether the factor has a positive or 


ne ; 5 : 
negative impact on quality from the consumer’s perspective. 


Using the Airline Quality Rating formula and recent data, 


produce AQR scores and rankings for the 10 major U.S. airlines 
shown in Case Exhibit 13.1—3. 


Airline Rankings 


Rank Airline AQR Score 
1 American 10.328 
2 Southwest 10.254 
3 Delta 10.209 
4 United 10.119 
5 USAir 10.054 
6 Pan Am 10.003 
7 Northwest 20.063 
8 Continental 20.346 
9 America West 20.377 

10 TWA 20.439 


What Course to Chart? 


Shocker has discovered what appear to be two different approaches 


to measuring quality of airlines. One relies on direct consumer 


opinion and is mostly subjective in its approach to quality and the 
elements considered. The other relies on performance data that are 
available through public sources and appear to be more objective. 
Both approaches incorporate pertinent elements that could be used 
by consumers to judge the quality of an airline. Shocker’s recom- 
mendation must consider the comprehensiveness and usefulness of 


1. Average age of fleet 25.85 
2. Number of aircraft 14.54 
3. On-time performance 18.63 
4. Load factor 26.98 
5. Pilot deviations 28.03 
6. Number of accidents 28.38 
7. Frequent-flier awards 2735 
8. Flight problems”? 28.05 
9. Denied boardings? 28.03 
10. Mishandled baggage? 27.92 
11. Fares? 27.60 
12. Customer service? 27.20 
13. Refunds 232 
14. Ticketing/boarding® -7.08 
15. Advertising” -6.82 
16. Credit? 25.94 
17. Other? 27.34 
18. Financial stability 26.52 
19. Average seat-mile cost 24.49 
wR WE TWE ar ee we 


AQR 
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a. The 19-item rating has a reliability coefficient (Cronbach's Alpha) of 0.87. 
b. Data for these factors come from consumer complaints registered with the 
Department of Transportation. 


To establish the 19 weighted factors, an opinion survey was 
conducted with a group of 65 experts in the aviation field. These 
experts included representatives of most major airlines, air travel 


experts, Federal Aviation Administration (FAA) representatives, aca- 
demic researchers, airline manufacturing and support firms, and indi- 
vidual consumers. Each expert was asked to rate the importance that 


each individual factor might have to a consumer of airline services 


these approaches for FlyAway Airways as it moves into a more com- 


petitive environment. What course of action should he recommend? 


Questions 


il, 


How comparable are the two different methods? In what ways 
are they similar? In what ways are they different? 

What are the positive and negative aspects of each approach 
that Shocker should consider before recommending a course of 
action for FlyAway Airways? 

What aspects of service quality does each approach address well 
and not so well? 

Considering the two methods outlined, what types of validity 
would you consider to be demonstrated by the two approaches 
to measuring quality? Defend your position. 

Which of the methods should Shocker recommend? Why? 


CHAPTER 14 


ATTITUDE 
MEASUREMENT 


After studying this chapter, you should be able to 


1. Describe how business researchers think of attitudes 
2. Identify basic approaches to measuring attitudes 


3. Discuss the use of rating scales for measuring attitudes 
4. Represent a latent construct by constructing a summated 


scale 
5. Summarize ways to measure attitudes with ranking and 


sorting techniques 
6. Discuss major issues involved in the selection of a 
measurement scale 


Chapter Vignette: Heat and Smoke—What Keeps 
Them Happy? 


The history of steel factories and the challenges of the furnace workers who work in those 
factories is well documented. While many people are familiar with the stories of the great 
steel industrialists such as Carnegie and Frick of the nineteenth century, few people realize 


that the work of the furnace worker continues to this day. It is hard and difficult 
work—despite the great advances in technology and an 


ever-increasing focus on safety, furnace workers still face 
dangerous work environments filled with heat and smoke. 
The molten metal must be carefully managed within the fur- 
nace, with temperatures in the vessel exceeding thousands 
of degrees. The possibility of critical injury or death is ever- 
present, either through the long-term exposure to metallic 
fumes or from the immediate effects of a furnace explosion. 

A company which specializes in making high-grade metals 
knew how important these furnace workers were to their success, 
and was keenly interested in what kept them satisfied with their 
company. Several of their furnace employees had been with them 
for over 20 years, and the skills and expertise of these experienced 
employees were invaluable to the training of new furnace workers, 
and the manufacturing process itself. 

A team of business researchers was asked to do an assessment 
of furnace employee attitudes, with the goal of identifying what 
aspects of their work environment contributed to their overall satis- 
faction. Using a survey questionnaire, a series of statements related 
to the company’s benefits, supervisory relationships, and general 
work-related conditions was developed. These researchers asked the 
furnace workers to indicate their level of agreement, on a scale which 
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ranged from strongly disagree to strongly agree, to these statements. Examples of these state- 


ments included: 
Our company has a health plan that addresses the needs of my family. 
My experiences with the health plan coordinator have been good. 


My supervisor sees me as an asset to the company. 
My supervisor encourages me to contribute ways that can make our work space better. 


SEW Ne 


My company puts safety as a top priority. 
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For each of the statements, the researchers compiled responses from the furnace workers to see if 
these areas were positively related to the overall work satisfaction of the furnace employees. Results 
showed some interesting outcomes. While the furnace workers viewed company health benefits and 
the company’s safety program as important to overall work satisfaction, the opportunity to have a 
supervisor who they perceived as valuing their input and who saw them as important assets to the 
company was a very important factor related to their satisfaction. 

In a nutshell, the very dangerous work environment of the furnace floor did require a focus on 
safety and health benefits in their minds. But not unlike workers in safer environments, it was the 
positive and supportive relationship with their immediate supervisor that really made the difference. 

Measurement of attitudes is a common objective in business research. Just as a company can apply 
this study's results to craft practical responses—for example, hiring and training supervisors who are 
oriented towards positively supporting their employees—other business researchers explore attitudes 
to answer questions that range from identifying needs to evaluating satisfaction with other aspects of 
a company’s work processes. This chapter describes various methods of attitude measurement. 
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Introduction 


For social scientists, an attitude is as an enduring disposition to respond consistently to specific 
aspects of the world, including actions, people, or objects. One way to understand an attitude 
is to break it down into its components. Consider this brief statement: “Sally likes shopping at 
Wal-Mart. She believes the store is clean, conveniently located, and has low prices. She intends 
to shop there every Thursday.” This simple example demonstrates attitude’s three components: 
affective, cognitive, and behavioral. The affective component refers to an individual’s general 
feelings or emotions toward an object. Statements such as “I really like my Corvette,” “I enjoy 
reading new Harry Potter books,” and “I hate cranberry juice” reflect an emotional character of 
attitudes. A person’s attitudinal feelings are driven directly by his/her beliefs or cognitions. This cog- 
nitive component represents an individual’s knowledge about attributes and their consequences. 
One person might feel happy about the purchase of an automobile because she believes the car 
“gets great gas mileage” or knows that the dealer is “the best in New Jersey.” The behavioral com- 
ponent of an attitude reflects a predisposition to action by reflecting an individual’s’ intentions. 


Attitudes as Hypothetical Constructs 


Business researchers often pose questions involving psychological variables that cannot directly be 
observed. For example, someone may have an attitude toward working on a commission basis. 
We cannot actually see this attitude. Rather, we can measure an attitude 
by making an inference based on the way an individual responds to mul- 
tiple scale indicators. Because we can’t directly see these phenomena, 
they are known as latent constructs, hypothetical constructs, or just simply 
constructs. Common constructs include job satisfaction, organizational 
commitment, personal values, feelings, role stress, perceived value, and 
many more. The Research Snapshot on page 317 talks about measuring 
love. Is love a hypothetical construct? 


Importance of Measuring Attitudes 


Most managers hold the intuitive belief that changing consumers’ or 
employees’ attitudes toward their company or their company’s products 
or services is a major goal. Because modifying attitudes plays a pervasive 
role in developing strategies to address these goals, the measurement of 
attitudes is an important task. For example, after Whiskas cat food had 
been sold in Europe for decades, the brand faced increased competition 


attitude 


An enduring disposition to 
consistently respond in a given 
manner to various aspects of the 
world, composed of affective, 
cognitive, and behavioral 
components. 


hypothetical constructs 


Variables that are not directly 
observable but are measurable 
through indirect indicators, such 
as verbal expression or overt 
behavior. 


While cats’ attitudes may be 
difficult to measure, we can easily 
measure how consumers feel 
about different types of cat food. 
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COURTESY OF QUALTRICS.COM 


This chapter focuses on different ways to assess respondent 
attitudes. One popular way is to use a multiattribute model. The 
process begins by asking respondents in one way or another to 


the work does not interfere with 
your personal life 


ranking 


A measurement task that requires 
respondents to rank order a 

small number of stores, brands, 
or objects on the basis of overall 
preference or some characteristic 
of the stimulus. 


rating 


A measurement task that 
requires respondents to estimate 
the magnitude of a characteristic 

or quality that a brand, store, or 
object possesses. 


sorting 


A measurement task that pre- 
sents a respondent with several 
objects or product concepts 
and requires the respondent to 
arrange the objects into piles or 
classify the product concepts. 
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evaluate the attributes that help form an attitude 

toward the activity involved. In our survey, we 

assess attitudes toward working in a specific busi- 
ness career (marketing, management, 
finance, or accounting). Each respon- 
dent's attribute evaluation is multiplied 
by the corresponding belief about whether or not 
the particular activity is associated with the attribute. 
This process is described in the chapter. After read- 
ing the chapter, see if you can compute respondents’ 
attitudes toward working in a business career (just 
consider each of the four disciplines a business career). 
Later, we'll actually revisit these attitude scores to see 
which business area is truly preferred. 


from new premium brands, and consumers had difficulty identifying with the brand. The com- 
pany conducted attitude research to determine how people felt about their cats and their food 
alternatives. The study revealed that cat owners see their pets both as independent and as depen- 
dent fragile beings.' Cat owners held the attitude that cats wanted to enjoy their food but needed 
nutrition. This attitude research was directly channeled into managerial action. Whiskas marketers 
begin positioning the product as having “Catisfaction,” using advertisements that featured a purr- 
ing silver tabby—a pedigreed cat—which symbolizes premium quality but also presents the image 
of a sweet cat. The message: “Give cats what they like with the nutrition they need. If you do, 
they’ll be so happy that they'll purr for you.” This effort reversed the sales decline the brand had 


been experiencing. 


Techniques for Measuring Attitudes 


A remarkable variety of techniques has been devised to measure attitudes. This variety stems in 
part from lack of consensus about the exact definition of the concept. In addition, the affective, 
cognitive, and behavioral components of an attitude may be measured by different means. For 
example, sympathetic nervous system responses may be recorded using physiological measures to 
quantify affect, but they are not good measures of behavioral intentions. Direct verbal statements 
concerning affect, belief, or behavior are used to measure behavioral intent. However, attitudes 
may also be interpreted using qualitative techniques like those discussed in Chapter 7. 

Research may assess the affective (emotional) components of attitudes through physiological 
measures such as galvanic skin response (GSR), blood pressure, and pupil dilation. These measures 
provide a means of assessing attitudes without verbally questioning the respondent. In general, 
they can provide a gross measure of likes or dislikes, but they are not extremely sensitive to the 
different gradients of an attitude. 

Obtaining verbal statements from respondents generally requires that the respondents perform 
a task such as ranking, rating, sorting, or making choices. A ranking task requires the respondent to 
rank order a small number of stores, brands, feelings, or objects on the basis of overall preference 
or some characteristic of the stimulus. Rating asks the respondent to estimate the magnitude or the 
extent to which some characteristic exists. A quantitative score results. The rating task involves 
marking a response indicating one’s position using one or more attitudinal or cognitive scales. A 
sorting task might present the respondent with several different concepts printed on cards and 
require the respondent to classify the concepts by placing the cards into groups (stacks of cards). 
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4 Is It Positive Emotionality, 
= “or ls it LOVE? 

Love is a four-letter word. Or is it more 
than that? Psychologists and cognitive scientists 
view love as just one example of positive emo- 

tionality, and have developed numerous definitions to describe 
what love is and how it works. In fact, a recent study found 
there are nine different ways love can be defined and/or mea- 


person incapable of responding positively and affectionately 
toward other people and things. Love and hate are constructs 
in that we invent these terms to explain why, for instance, a 
young man spends all his time with one young woman while 
completely avoiding another. From a scientific point of view, we 
might be better off if we said that this young man’s behavior 
suggested that he had a relatively enduring, positive-approach 
attitude toward the first woman and a negative avoidance atti- 


sured! The concept of love is a hypothetical construct—that is, tude toward the second. 


a term that psychologists use to describe or explain a particular 
pattern of human behavior. Love, hate, thirst, learning, intelli- 
gence—all of these are hypothetical constructs. They are hypo- 
thetical in that they do not exist as physical entities; therefore, 
they cannot be seen, heard, felt, or measured directly. There 

is no love center in the brain that, if removed, would leave a 


Source: Based on Myers, Jane and 
Matthew Shurts, “Measuring Positive 
Emotionality: A Review of Instruments 
Assessing Love,” Measurement 

and Evaluation in Counseling and 
Development 34 (2002), 238-254. 


Another type of attitude measurement is choice between two or more alternatives. If a respondent 
chooses one object over another, the researcher assumes that the respondent prefers the chosen 
object, at least in this setting. The following sections describe the most popular techniques for 
measuring attitudes. 


Attitude Rating Scales 


Perhaps the most common practice in business research is using rating scales to measure attitudes. 
This section discusses many rating scales designed to enable respondents to report the intensity of 
their attitudes. 


Simple Attitude Scales 


In its most basic form, attitude scaling requires that an individual agree or disagree with a state- 
ment or respond to a single question. For example, respondents in a political poll may be asked 
whether they agree or disagree with the statement “The president should run for re-election.” 
Or, an individual might indicate whether he or she likes or dislikes jalapeño bean dip. This type 
of self-rating scale merely classifies respondents into one of two categories, thus having only the 
properties of a nominal scale, and the types of mathematical analysis that may be used with this 
basic scale are limited. 

Despite the disadvantages, simple attitude scaling may be used when questionnaires are 
extremely long, when respondents have little education, or for other specific reasons. A number 
of simplified scales are merely checklists: A respondent indicates past experience, preference, and 
the like merely by checking an item. In many cases the items are adjectives that describe a particu- 
lar object. In a survey of small-business owners and managers, respondents indicated whether they 
found working in a small firm more rewarding than working in a large firm, as well as whether 
they agreed with a series of attitude statements about small businesses. For example, 77 percent 
said small and mid-sized businesses “have less bureaucracy,” and 76 percent said smaller companies 
“have more flexibility” than large ones.* 

Most attitude theorists believe that attitudes vary along continua. Early attitude researchers pio- 
neered the view that the task of attitude scaling is to measure the distance from “good” to “bad,” 
“low” to “high,” “like” to “dislike,” and so on. Thus, the purpose of an attitude scale is to find an 
individual’s position on the continuum. However, simple scales do not allow for fine distinctions 
between attitudes. Several other scales have been developed for making more precise measurements. 


A measurement task that identi- 
fies preferences by requiring 
respondents to choose between 
two or more alternatives 
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category scale 


A rating scale that consists of sev- 
eral response categories, often 
providing respondents with alter- 
natives to indicate positions on a 
continuum. 


Likert scale 


A measure of attitudes designed 
to allow respondents to rate how 
strongly they agree or disagree 
with carefully constructed state- 
ments, ranging from very positive 
to very negative attitudes toward 
some obiect. 
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Students Ask—Are You Responsible? 
Businesses today face an increasing need to be perceived as 
having an interest in social responsibility. In many instances, 
products and services have been promoted based upon the fact 
that the product or service is environmentally friendly, or has 

a tie to improving the social environment. Companies such as 
Toyota (with an emphasis on hybrid vehicles) and Yoplait (with its 


recently surveyed 1,554 college students to 
determine their opinions about corporate 
social responsibility. Results indicate that 
41 percent of college students consciously 
prefer products and services from compa- 
nies they perceive as having a social role. Large 
companies such as Toyota and smaller companies like Burt's Bees 
were ranked as highly socially responsible brands. 

The implications for business leaders are quite interesting. 
Increasingly, perceptions of the company itself, and not just 
its products, drive purchasing decisions among this important 
demographic. 


contributions to breast cancer 
research) highlight a trend that 
showing interest in improving 
the world can also have bot- 
tom line implications. The Alloy 
Eighth Annual College Explorer 
study, conducted with the 
assistance of the Harris Group, 


Source: Based on Bush, Michael, “Students Rank Social Responsibility,” Advertising 
Age 79 (August 4, 2008), 11. 


Category Scales 


The simplest rating scale contains only two response categories: agree/disagree. Expanding the 
response categories provides the respondent with more flexibility in the rating task. Even more 
information is provided if the categories are ordered according to a particular descriptive or evalu- 
ative dimension. Consider the following question: 


How often do you disagree with your spouse about how much to spend on vacation? 


Never Rarely Sometimes Often Very often 


This category scale is a more sensitive measure than a scale that has only two response catego- 
ries. By having more choices for a respondent, the potential exists to provide more information. 
However, if the researcher tries to represent something that is truly bipolar (yes/no, female/male, 
member/nonmember, and so on) with more than two categories, error may be introduced. 
Question wording is an extremely important factor in the usefulness of these scales. Exhibit 14.1 
shows some common wordings used in category scales. The issue of question wording is discussed in 


Chapter 15. 


Method of Summated Ratings: The Likert Scale 


A method that is simple to administer and therefore extremely popular is business researchers’ adapta- 
tion of the method of summated ratings, developed by Rensis Likert.’ With the Likert scale, respon- 
dents indicate their attitudes by checking how strongly they agree or disagree with carefully constructed 
statements, ranging from very positive to very negative attitudes toward some object. Individuals 
generally choose from approximately five response alternatives—strongly agree, agree, uncertain, dis- 
agree, and strongly disagree—although the number of alternatives may range from three to nine. In 
the following example, from a study of food-shopping behavior, there are five alternatives: 


In buying food for my family, price is no object. 


Strongly Disagree Disagree Uncertain Agree Strongly Agree 


(1) (2) (3) (4) (5) 


Researchers assign scores, or weights, to each possible response. In this example, numerical 
scores of 1, 2, 3, 4, and 5 are assigned to each level of agreement, respectively. The numerical 
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EXHIBIT 14.1 Selected Category Scales 


Excellent Good Fair Poor 
Very good Fairly good Neither good nor bad Not very good Not good at all 
Well above average Above average Average Below average Well below average 


Importance 


Very important Fairly important Neutral Not so important Not at all important 


Very interested Somewhat interested Not very interested 


Satisfaction 


Completely Somewhat Neither satisfied Somewhat Completely 
satisfied satisfied nor dissatisfied dissatisfied dissatisfied 
Very satisfied Quite satisfied Somewhat satisfied Not at all satisfied 


All of the time Very often Often Sometimes Hardly ever 
Very often Often Sometimes Rarely Never 

All of the time Most of the time Some of the time Just now and then 

Very true Somewhat true Not very true Not at all true 

Definitely yes Probably yes Probably no Definitely no 


Very different Somewhat Slightly different Not at all different 
different 
Extremely unique Very unique Somewhat unique Slightly unique Not at all unique 


scores, shown in parentheses, may not be printed on the questionnaire or computer screen. Strong 
agreement indicates the most favorable attitude on the statement, and a numerical score of 5 is 
assigned to this response. 


E REVERSE RECODING 


The statement given in this example is positively framed. Ifa statement is framed negatively (such as “I 
carefully budget my food expenditures”), the numerical scores would need to be reversed. This is done 
by reverse recoding the negative item so that a strong agreement really indicates an unfavorable response reverse recoding 


rather than a favorable attitude. In the case of a five-point scale, the recoding is done as follows: A method of making sure all the 
items forming a composite scale 
are scored in the same direction. 
Negative items can be recoded 
1 5 into the equivalent responses for 
a non-reverse coded item. 


2 4 
3 3 
4 2 
5 1 


Recoding in this fashion turns agreement with a negatively worded item into a mirror image, 
meaning the result is the same as disagreement with a positively worded item. SPSS has a recode 
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composite scale 


A way of representing a latent 
construct by summing or averag- 
ing respondents’ reactions to 
multiple items each assumed to 
indicate the latent construct. 


Likert Scale Items for 
Measuring Attitudes toward 
Patients’ Interaction with a 
Physician’s Service Staff 


semantic differential 


A measure of attitudes that 
consists of a series of seven- 
point rating scales that use 
bipolar adjectives to anchor the 
beginning and end of each scale. 
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function that allows simple recoding to be done by entering “old” and “new” scale values. Alter- 
natively, a simple mathematical formula can be entered. For a typical 1—5 scale, the formula 
=6-— X 


new value old value 


would result in the same recoding. 


COMPOSITE SCALES 


A Likert scale may include several scale items to form a composite scale. Each statement is assumed 
to represent an aspect of a common attitudinal domain. For example, Exhibit 14.2 shows the items 
in a Likert scale for measuring attitudes toward patients’ interaction with a physician’s service staff. 
The total score is the summation of the numerical scores assigned to an individual’s responses. 
Here the maximum possible score for the composite would be 20 ifa 5 were assigned to “strongly 
agree” responses for each of the positively worded statements and a 5 to “strongly disagree” 
responses for the negative statement. Item 3 is negatively worded and therefore it is reverse coded, 
prior to being used to create the composite scale. 


My doctor's office staff takes a warm and personal interest in me. 
My doctor's office staff is friendly and courteous. 
My doctor's office staff is more interested in serving the doctor's needs than in serving my needs. 


pa EO IS 


My doctor's office staff always acts in a professional manner. 


Source: Brown, S. W., Swartz, T. A. (1989), “A gap analysis of professional services quality’, Journal of Marketing, Vol. 54, pp. 92-8. 
Copyright 1989 by Am. Marketing Assn (AMA (Chic). Reproduced with permission of Am. Marketing Assn (AMA (Chic) in the 
format Textbook via Copyright Clearance Center. 


In Likert’s original procedure, a large number of statements are generated, and an item analysis 
is performed. The purpose of the item analysis is to ensure that final items evoke a wide response 
and discriminate among those with positive and negative attitudes. Items that are poor because 
they lack clarity or elicit mixed response patterns are eliminated from the final statement list. 
Scales that use multiple items can be analyzed for reliability and validity. Only a set of items that 
demonstrates good reliability and validity should be summed or averaged to form a composite 
scale representing a hypothetical construct. Unfortunately, not all researchers are willing or able 
to thoroughly assess reliability and validity. Without this test, the use of Likert scales can be disad- 
vantageous because there is no way of knowing exactly what the items represent or how well they 
represent anything of interest. Without valid and reliable measures, researchers cannot guarantee 
they are measuring what they say they are measuring. 


Semantic Differential 


The semantic differential is actually a series of attitude scales. This popular attitude measurement 
technique consists of getting respondents to react to some concept using a series of seven-point 
bipolar rating scales. Bipolar adjectives—such as “good” and “bad,” “modern” and “old- 
fashioned,” or “clean” and “dirty”—anchor the beginning and the end (or poles) of the scale. The 
subject makes repeated judgments about the concept under investigation on each of the scales. 
Exhibit 14.3 shows seven of eighteen scales used in a research project that measured attitudes 
toward supermarkets. 

The scoring of the semantic differential can be illustrated using the scale bounded by the 
anchors “modern” and “old-fashioned.” Respondents are instructed to check the place that indi- 
cates the nearest appropriate adjective. From left to right, the scale intervals are interpreted as 
slightly modern,” “both modern and old-fashioned,” 


2 6 


“extremely modern,” “very modern, 
“slightly old-fashioned,” “very old-fashioned,” and “extremely old-fashioned”: 


Modern Old-fashioned 


The semantic differential technique originally was developed as a method for measuring the 
meanings of objects or the “semantic space” of interpersonal experience.* Researchers have found 
the semantic differential versatile and useful in business applications. The validity of the semantic 
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Inconvenient location Convenient location 


Low prices High prices 


Pleasant atmosphere Unpleasant atmosphere 


Modern. Old-fashioned 
Cluttered... TTT Spacious 
Fastcheckout— Slow checkout 
Dull 2 Exciting 


Source: Yu, Julie H., Gerald Albaum, and Michael Swenson, “Is a Central Tendency Error Inherent in the Use of Semantic 
Differential Scales in Different Cultures?” International Journal of Market Research, Summer 2003, downloaded from Business 
& Company Resource Center, http://galenet.galegroup.com. 


differential depends on finding scale anchors that are semantic opposites. This can sometimes 
prove difficult. However, in attitude or image studies simple anchors such as very unfavorable and 
very favorable work well. 

For scoring purposes, a numerical score is assigned to each position on the rating scale. Tradi- 
tionally, score ranges such as 1, 2, 3, 4, 5, 6, 7 or —3, —2, —1, 0, +1, +2, +3 are used. Many busi- 
ness researchers find it desirable to assume that the semantic differential provides interval data. This 


assumption, although widely accepted, has its critics, who argue that the data have only ordinal 
properties because the numerical scores are arbitrary. Practically speaking, most researchers will treat 
semantic differential scales as metric (at least interval). This is because the amount of error introduced 
by assuming the intervals between choices are equal (even though this is uncertain) is fairly small. 

Exhibit 14.4 illustrates a typical image profile based on semantic differential data. Because the 
data are assumed to be interval, either the arithmetic mean or the median will be used to compare 
the profile of one product, brand, or store with that of a competing product, brand, or store. 


Image Profile of Commuter Airlines versus Major Airlines 


Positive Neutral Negative 


Consistently on time Typically late 


Reliable baggage handling 
Desirable schedule 


Security conscious 


Quiet equipment 


Roomy planes 


Clean equipment 


Polite personnel 
Knowledgeable personnel 


Prompt service by personnel 


High value for money spent 


Economical Expensive 
Profitable Unprofitable 
Reliable Unsafe 


Commuter Airlines 
Major Airlines 


Loud equipment 
Crowded planes 
Dirty equipment 
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Semantic Differential Scales 
for Measuring Attitudes 
toward Supermarkets 


image profile 


A graphic representation of 
semantic differential data for 
competing brands, products, or 
stores to highlight comparisons. 


Undependable baggage handling 
Inconvenient schedule 
Not security conscious 


Discourteous personnel 
Uninformative personnel 
Slow service by personnel 
Low value for money spent 


Source: Jones, J. Richard and Sheila |. Cocke, “A Performance Evaluation of Commuter Airlines: The Passengers’ View,” Proceedings: 


Transportation Research Forum 22 (1981), p. 524. Reprinted with permission. 


© PHOTODISC/GETTY IMAGES 


A Measuring Stick for Web Site Usability 

Two technology experts looking for a standard way to measure 
Web sites’ usability developed metrics emphasizing attitudes. 
Rather than, say, measuring how long it took users to accomplish 


a particular task, they asked use 
each site. Each rater evaluated t 
and transactions), ease of use, p 
site), “made for the medium” (fe 


user's particular needs), and emotions (sense of accomplishment, 


interest in the site’s content, cre 
of content). 


Of course, what is very important on one site may be minor 
on another. A prospective investor looking for information about 
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numerical scale 


An attitude rating scale similar 
to a semantic differential except 
that it uses numbers, instead of 
verbal descriptions, as response 
options to identify response 
positions. 


Stapel scale 


A measure of attitudes that 
consists of a single adjective in 
the center of an even number of 
numerical values. 
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the usability assessment begins by asking E 
respondents to rate each category being 
evaluated in terms of how important it is f 
for a particular kind of company, assuming 

the rater is either a consumer or an investor. 
For example, a user might rate an airline Web 
site's content, ease of use, and so on for a consumer. These rat- 
ings use a 100-point constant-sum scale. Each rater divides 100 
points among the five categories. The rater then evaluates, on a 
scale of 1 to 10, how well the site performs in each category. The 
importance ratings weight those scores. So, if a rater assigns 5 
points to the emotion category and thinks the site performs at 

a 6 on the 1-to-10 scale, the weighted score is 30. By combining 
all the ratings for a Web site, a site can earn between 0 and 1,000 
points. In the researchers’ test of this rating system, it delivered 
helpful insights. 


rs to rate their experiences using 
he site’s content (information 
romotion (advertising on the 
atures that make the site fit the 


dibility, and control over the flow 


an airline would likely seek a 
different online experience 
than a consumer visiting the 
same site to plan a vacation, 
and they both would have still 
different expectations for an 
online bookstore. As a result, 


Source: Based on Ritu Agarwal and Viswanath Venkatesh, “Assessing a Firm’s 

Web Presence: A Heuristic Evaluation Procedure for the Measurement of 
Usability,” Information Systems Research (June 2002), http://galenet.galegroup.com; 
Buchholz, G. A., “Losability vs. Usability,” Digital Web (July 11, 2005), http://www. 
digital-web.com. 


Numerical Scales 


A numerical scale simply provides numbers rather than a semantic space or verbal descriptions 
to identify response options or categories (response positions). For example, a scale using five 
response positions is called a five-point numerical scale. A six-point scale has six positions and a 
seven-point scale seven positions, and so on. Consider the following numerical scale: 


Now that you’ve had your automobile for about one year, please tell us how 
satisfied you are with your Ford Taurus. 
Extremely Dissatisfied 1 2 3 4 5 6 7 Extremely Satisfied 


This numerical scale uses bipolar adjectives in the same manner as the semantic differential. 

In practice, researchers have found that a scale with numerical labels for intermediate points 
on the scale is as effective a measure as the true semantic differential. The Research Snapshot 
above demonstrates how numerical scales can be helpful in assessing Web site effectiveness. 


Stapel Scale 


The Stapel scale, named after Jan Stapel, was originally developed in the 1950s to measure simul- 
taneously the direction and intensity of an attitude. Modern versions of the scale, with a single 
adjective, are used as a substitute for the semantic differential when it is difficult to create pairs 
of bipolar adjectives. The modified Stapel scale places a single adjective in the center of an even 
number of numerical values (ranging, perhaps, from +3 to —3). The scale measures how close to 
or distant from the adjective a given stimulus is perceived to be. Exhibit 14.5 illustrates a Stapel 
scale item used in measurement of a retailer’s store image. 

The advantages and disadvantages of the Stapel scale are very similar to those of the semantic 
differential. However, the Stapel scale is markedly easier to administer, especially over the tele- 
phone. Because the Stapel scale does not require bipolar adjectives, it is easier to construct than the 
semantic differential. Research comparing the semantic differential with the Stapel scale indicates 
that results from the two techniques are largely the same." 
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Bloomingdale’s 


13 

12 

14] 
Wide Selection 

21 

22 

23 


Select a plus number for words that you think describe the store accurately. The more accurately you think 
the word describes the store, the larger the plus number you should choose. Select a minus number for 
words you think do not describe the store accurately. The less accurately you think the word describes the 
store, the larger the minus number you should choose. Therefore, you can select any number from 13 for 
words that you think are very accurate all the way to 23 for words that you think are very inaccurate. 


Source: Menezes, Dennis and Norbert F. Elbert, “Alternative Semantic Scaling Formats for Measuring Store Image: An 
Evaluation,” Journal of Marketing Research, February 1979, pp. 80-87. Reprinted by permission of the American Marketing 
Association. 


Constant-Sum Scale 


A constant-sum scale requires respondents to divide a fixed number of points among several attri- 
butes corresponding to their relative importance or weight. Suppose United Parcel Service (UPS) 
wishes to determine the importance of the attributes of accurate invoicing, delivery as promised, 
and price to organizations that use its service in business-to-business settings. Respondents might be 
asked to divide a constant sum of 100 points to indicate the relative importance of those attributes: 


Divide 100 points among the following characteristics of a delivery service according to how important each 
characteristic is to you when selecting a delivery company. 

___ Accurate invoicing 

___ Package not damaged 

____ Delivery as promised 

___ Lower price 

—— 100 points 


The constant-sum scale works best with respondents who have high educational levels. If respon- 
dents follow the instructions correctly, the results will approximate interval measures. As the 
number of stimuli increases, this technique becomes increasingly complex. 

This technique may be used for measuring brand preference. The approach, which is similar 
to the paired-comparison method, is as follows: 


Divide 100 points among the following brands according to your preference for each brand: 
— Brand A 

___ Brand B 

—  BrandC 

—— 100 points 


In this case, the constant-sum scale is a rating technique. However, with minor modifications, it 
can be classified as a sorting technique. Although the constant-sum scale is widely used, strictly 
speaking, the scale is flawed because the last response is completely determined by the way the 
respondent has scored the other choices. Although this is probably somewhat complex to under- 
stand, the fact is that practical reasons often outweigh this concern. 


Graphic Rating Scales 


A graphic rating scale presents respondents with a graphic continuum. The respondents are allowed 
to choose any point on the continuum to indicate their attitude. Exhibit 14.6 on the next page 
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A Stapel Scale for Measuring 
a Store’s Image 


constant-sum scale 


A measure of attitudes in which 
respondents are asked to divide 
a constant sum to indicate the 
relative importance of attributes; 
respondents often sort cards, but 
the task may also be a rating task. 


graphic rating scale 


A measure of attitude that allows 
respondents to rate an object 

by choosing any point along a 
graphic continuum. 
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Graphic Rating Scale 


A Ladder Scale 
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Please evaluate each attribute in terms of how important it is to you by placing an X at the position 
on the horizontal line that most reflects your feelings. 


Seating comfort Not important Very important 
In-flight meals Not important Very important 
Airfare Not important Very important 


shows a traditional graphic scale, ranging from one extreme position to the opposite position. 
Typically a respondent’s score is determined by measuring the length (in millimeters) from one 
end of the graphic continuum to the point marked by the respondent. Many researchers believe 
that scoring in this manner strengthens the assumption that graphic rating scales of this type are 
interval scales. Alternatively, the researcher may divide the line into predetermined scoring cat- 
egories (lengths) and record respondents’ marks accordingly. In other words, the graphic rating 
scale has the advantage of allowing the researcher to choose any interval desired for scoring pur- 
poses. The disadvantage of the graphic rating scale is that there are no standard answers. 

Graphic rating scales are not limited to straight lines as sources of visual communication. 
Picture response options or another type of graphic continuum may be used to enhance com- 
munication with respondents. A variation of the graphic ratings scale is the ladder scale. This scale 
also includes numerical options: 


Here is a ladder scale (response scale is shown in Exhibit 14.7). It represents the “ladder of life.” As you 
see, it is a ladder with eleven rungs numbered O to 10. Let’s suppose the top of the ladder represents the 
best possible life for you as you describe it, and the bottom rung represents the worst possible life for you 
as you describe it. 

On which rung of the ladder do you feel your life is today? 

0 1 2 3 4 5 6 7 8 9 10 


Best Possible Life 
10 


Worst Possible Life 
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4 How Much Is a Healthy 
= ~ Home Worth? 

Homebuilders need to know what con- 
sumers like, but before they invest in a lot of expen- 
sive features, they should know what consumers 

will pay for. If consumers’ budgets require some hard choices, the 
homebuilder needs to know which features are extremely valued, 
which are nice but not important, and which are difficult to trade 
off because they are so close in buyer's minds. When a group of 
researchers at the University of British Columbia wanted to mea- 
sure attitudes toward features of “healthy houses,” they compared 
the scores with a Thurstone scale. 

A healthy house refers to one built with materials and a 
design affording superior indoor air quality, lighting, and acous- 
tics. The researchers mailed a survey asking respondents whether 
they would be willing to pay extra if the builder could guarantee 
better indoor air quality, lighting systems, and acoustics. The 
survey also presented nine attributes associated with superior 
indoor air quality and energy efficiency. These were presented in 
every combination of pairs, and the respondents were directed 


to choose which item in each pair they considered more impor- 
tant. Responses to the paired-comparison questions generated a 
ranking, which the researchers used to create a Thurstone scale. 
The highest-ranked attribute (energy efficiency) appears at the 
top of the scale, with the next attribute (natural light) signifi- 
cantly below it. Thicker insula- 
tion, anti-allergic materials, 
and airtightness are grouped 
close together below natural 
light, and artificial light falls 
noticeably below the other 
features. 


Source: Spetic, Wellington, Robert 
Kozak, and David Cohen, “Willingness 
to Pay and Preferences for Healthy 
Home Attributes in Canada,” Forest 
Products Journal 55 (October 2005), 
19-24; Bower, John, Healthy House 
Building for the New Millennium, 
(Bloomington, IN: Healthy House 
Institute, 1999). 
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Research to investigate children’s attitudes has used happy-face scales (see Exhibit 14.8). The 


children are asked to indicate which face shows how they feel about candy, a toy, or some other 
concept. Research with the happy-face scale indicates that children tend to choose the faces at the 
ends of the scale. Although this may be because children’s attitudes fluctuate more widely than 
adults’ or because they have stronger feelings both positively and negatively, the tendency to select 
the extremes is a disadvantage of the scale. 


Happy-Face Scale 


3 2 1 
Very Good Very Poor 


Thurstone Interval Scale 


In 1927 attitude research pioneer Louis Thurstone developed the concept that attitudes vary along 
continua and should be measured accordingly. The construction of a Thurstone scale is a fairly 
complex process that requires two stages. The first stage is a ranking operation, performed by 
judges who assign scale values to attitudinal statements. The second stage consists of asking subjects 
to respond to the attitudinal statements. 

The Thurstone method is time-consuming and costly. From a historical perspective, it is valu- 
able, but its current popularity is low. This method is rarely used in applied research settings. 
Exhibit 14.9 on the next page summarizes the attitude-rating techniques discussed in this section. 


Graphic Rating Scale 

with Picture Response 
Categories Stressing Visual 
Communication 


Thurstone scale 


An attitude scale in which judges 
assign scale values to attitudi- 
nal statements and subjects 

are asked to respond to these 
statements. 
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» Summary of Advantages and Disadvantages of Rating Scales 


Rating Measure 


Category scale 


Likert scale 


Semantic differential 
and numerical scales 


Stapel scale 


Constant-sum scale 


Graphic scale 


Graphic scale with picture 
response categories 


Subject Must 


Indicate a response category 


Evaluate statements on 
a scale of agreement 


Choose points between 
bipolar adjectives on relevant 
dimensions 


Choose points ona scale 
with a single adjective in 
the center 


Divide a constant sum among 
response alternatives 


Choose a point ona 
continuum 


Choose a visual picture 


Measuring Behavioral Intention 


Advantages 


Flexible, easy to respond to 


Easiest scale to construct 


Easy to construct; norms exist 
for comparison, such as profile 
analysis 


Easier to construct than 
semantic differential, easy to 
administer 


Approximates an interval 
measure 


Visual impact, unlimited scale 
points 


Visual impact, easy for poor 
readers 
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Disadvantages 


Items may be ambiguous; 
with few categories, only 
gross distinctions can be 
made 


Hard to judge what a single 
score means 


Bipolar adjectives must be 
found; data may be ordinal, 
not interval 

Endpoints are numerical, not 
verbal, labels 

Difficult for respondents with 
low education levels 

No standard answers 


Hard to attach a verbal 
explanation to a response 


The behavioral component of an attitude involves the behavioral expectations of an individual 


toward an attitudinal object. The component of interest to researchers may be turnover intentions, 


a tendency to make business decisions in a certain way, or plans to expand operations or product 


offerings. For example, category scales for measuring the behavioral component of an attitude ask 


about a respondent’s likelihood of purchase or intention to perform some future action, using 


questions such as the following: 


How likely is it that you will purchase an MP3 player such as an iPod? 


e I definitely will buy. 
e — I probably will buy. 
e I might buy. 


e — I probably will not buy. 
e I definitely will not buy. 


How likely am I to write a letter to my representative in Congress or other government official in support 
of this company if it were in a dispute with government? 


° Extremely Likely 
e Very Likely 
° Somewhat Likely 


e Likely, about a 50-50 chance 


e = Somewhat Unlikely 
s Very Unlikely 
e — Absolutely Unlikely 


The wording of statements used in these scales often includes phrases such as “I would recom- 


mend,” “I would write,” or “I would buy” to indicate action tendencies. 


Expectations also may be measured using a scale of subjective probabilities, ranging from 100 
for “absolutely certain” to 0 for “absolutely no chance.” Researchers have used the following 
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subjective probability scale to estimate the chance that a job candidate will accept a position within 
a company: 


100% (Absolutely certain) I will accept 

90% (Almost sure) I will accept 

80% (Very big chance) I will accept 

70% (Big chance) I will accept 

60% (Not so big a chance) I will accept 

50% (About even) I will accept 

40% (Smaller chance) I will accept 

30% (Small chance) I will accept 

20% (Very small chance) I will accept 

10% (Almost certainly not) I will accept 
0% (Certainly not) I will accept 


Behavioral Differential 


A general instrument, the behavioral differential, is used to measure the behavioral intentions of 
subjects toward an object or category of objects. As in the semantic differential, a description of 
the object to be judged is followed by a series of scales on which subjects indicate their behavioral 
intentions toward this object. For example, one item might be something like this: 


A 25-year-old female sales representative 
Would Would not 


ask this person for advice. 


Ranking 


Consumers often rank order their preferences. An ordinal scale may be developed by asking respon- 
dents to rank order (from most preferred to least preferred) a set of objects or attributes. Respon- 
dents easily understand the task of rank ordering the importance of product attributes or arranging 
a set of brand names according to preference. Like the constant-sum scale, technically the ranking 
scale also suffers from inflexibility in that if we know how some ranked five out of six alternatives, 
we know the answer to the sixth. 


Paired Comparisons 


Consider a situation in which a chainsaw manufacturer learned that a competitor had introduced a new 
lightweight (6-pound) chainsaw. The manufacturer’s lightest chainsaw weighed 9 pounds. Executives 
wondered if they needed to introduce a 6-pound chainsaw into the product line. The research design 
chosen was a paired comparison. A 6-pound chainsaw was designed, and a prototype built. To control 
for color preferences, the competitor’s chainsaw was painted the same color as the 9- and 6-pound 
chainsaws. Respondents were presented with two chainsaws at a time and asked to pick the one they 
preferred. Three pairs of comparisons were required to determine the most preferred chainsaw. 
The following question illustrates the typical format for asking about paired comparisons. 


I would like to know your overall opinion of two brands of adhesive bandages. They are Curad and Band- 
Aid. Overall, which of these two brands—Curad or Band-Aid—do you think is the better one? Or are 
both the same? 


Curad is better. 
Band-Aid is better. 
They are the same. 


If researchers wish to compare four brands of pens on the basis of attractiveness or writing quality, 
six comparisons [(n)(n — 1)/2] will be necessary. 

When comparing only a few items, ranking objects with respect to one attribute is not dif- 
ficult. As the number of items increases, the number of comparisons increases geometrically. If 
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—Oscar Wilde 


behavioral differential 


A rating scale instrument similar 
to a semantic differential, devel- 
oped to measure the behavioral 
intentions of subjects toward 
future actions. 


paired comparison 


A measurement technique that 
involves presenting the respon- 
dent with two objects and ask- 
ing the respondent to pick the 
preferred object; more than two 
objects may be presented, but 
comparisons are made in pairs. 
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the number of comparisons is too large, respondents may become fatigued and no longer carefully 
discriminate among them. 


Sorting 


Sorting tasks ask respondents to indicate their attitudes or beliefs by arranging items on the basis 
of perceived similarity or some other attribute. One advertising agency has had consumers sort 
photographs of people to measure their perceptions of a brand’s typical user. Another agency used 
a sorting technique in which consumers used a deck of 52 cards illustrating elements from adver- 
tising for the brand name being studied. The study participants created a stack of cards showing 
elements they recalled seeing or hearing, and the interviewer then asked the respondent to identify 
the item on each of those cards. National City Corporation, a banking company, has used sorting 
as part of its research into the design of its Web site. Consumers participating in the research were 
given a set of cards describing various parts of processes that they might engage in when they are 
banking online. The participants were asked to arrange the cards to show their idea of a logical 
way to complete these processes. This research method shows the Web site designers how con- 
sumers go about doing something—sometimes very differently from the way bankers expect.‘ 

A variant of the constant-sum technique uses physical counters (for example, poker chips or 
coins), to be divided among the items being tested. In an airline study of customer preferences, 
the following sorting technique could be used: 


Here is a sheet that lists several airlines. Next to the name of each airline is a pocket. Here are ten cards. 
I would like you to put these cards in the pockets next to the airlines you would prefer to fly on your next 
trip. Assume that all of the airlines fly to wherever you would choose to travel. You can put as many cards 
as you want next to an airline, or you can put no cards next to an airline. 


Cards 


American Airlines 
Delta Airlines 
United Airlines 
Southwest Airlines 
Northwest Airlines 


Other Methods of Attitude Measurement 


Attitudes, as hypothetical constructs, cannot be observed directly. We can, however, infer one’s 
attitude by the way he or she responds to multiple attitude indicators. A summated rating scale can 
be made up of three indicators of attitude. Consider the following three semantic differential items 
that may capture a person’s attitude towards their immediate supervisor: 


very good very bad 
very unfavorable very favorable 
very positive very negative 


The terminology is such that now attitude would be represented as a latent (unobservable) con- 
struct indicated by the person’s response to these items. 


Selecting a Measurement Scale: 
Some Practical Decisions 


Now that we have looked at a number of attitude measurement scales, a natural question arises: 
“Which is most appropriate?” As in the selection of a basic research design, there is no single best 
answer for all research projects. The answer to this question is relative, and the choice of scale will 
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depend on the nature of the attitudinal object to be measured, the manager’s problem defini- 
tion, and the backward and forward linkages to choices already made (for example, telephone 
survey versus mail survey). However, several questions will help focus the choice of a measure- 


ment scale: 

1. Isa ranking, sorting, rating, or choice technique best? 

2. Should a monadic or a comparative scale be used? 

3. What type of category labels, if any, will be used for the rating scale? 

4. How many scale categories or response positions are needed to accurately measure an attitude? 
5. Should a balanced or unbalanced rating scale be chosen? 

6. Should a scale that forces a choice among predetermined options be used? 

7. Should a single measure or an index measure be used? 


We will discuss each of these issues. 


Ranking, Sorting, Rating, or Choice Technique? 


The decision whether to use ranking, sorting, rating, or a choice technique is determined largely 
by the problem definition and especially by the type of statistical analysis desired. For example, 
ranking provides only ordinal data, limiting the statistical techniques that may be used. 


Monadic or Comparative Scale? 


If the scale to be used is not a ratio scale, the researcher must decide whether to include a standard 
of comparison in the verbal portion of the scale. Consider the following rating scale: 


Now that you’ve had your automobile for about one year, please tell us how satisfied you are with its 
engine power and pickup. 


Completely Somewhat Completely 


Dissatisfied Dissatisfied Satisfied Satisfied Satisfied 


This is a monadic rating scale, because it asks about a single concept (the brand of automobile monadic rating scale 


the individual actually purchased) in isolation. The respondent is not given a specific frame Any measure of attitudes that 
of reference. A comparative rating scale asks a respondent to rate a concept, such as a specific asks respondents about a single 
amount of responsibility or authority, in comparison with a benchmark—perhaps another simi- concept in isolation. 


lar concept—explicitly used as a frame of reference. In many cases, the comparative rating scale comparative rating scale 


presents an ideal situation as a reference point for comparison with the actual situation. For Any measure of attitudes that 


example: asks respondents to rate a 
concept in comparison with a 


f ; i benchmark explicitly used as a 
ity that would be ideal for this position. frame of reference. 


Please indicate how the amount of authority in your present position compares with the amount of author- 


Too much About right Too little 


What Type of Category Labels, If Any? 


We have discussed verbal labels, numerical labels, and unlisted choices. Many rating scales have 
verbal labels for response categories because researchers believe they help respondents better 
understand the response positions. The maturity and educational levels of the respondents will 
influence this decision. The semantic differential, with unlabeled response categories between 
two bipolar adjectives, and the numerical scale, with numbers to indicate scale positions, often are 
selected because the researcher wishes to assume interval-scale data. 
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balanced rating scale 


A fixed-alternative rating scale 
with an equal number of positive 
and negative categories; a neu- 
tral point or point of indifference 
is at the center of the scale. 


unbalanced rating scale 


A fixed-alternative rating scale 
that has more response cat- 
egories at one end than the 

other, resulting in an unequal 
number of positive and negative 
categories. 


forced-choice rating scale 


A fixed-alternative rating scale 
that requires respondents 
to choose one of the fixed 

alternatives. 


an 


having one, isn't 1t? 


—Luigi Pirandello 
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How Many Scale Categories or Response Positions? 


Should a category scale have four, five, or seven response positions or categories? Or should 
the researcher use a graphic scale with an infinite number of positions? The original devel- 
opmental research on the semantic differential indicated that five to eight points is optimal. 
However, the researcher must determine the number of meaningful positions that is best for 
the specific project. This issue of identifying how many meaningful distinctions respondents 
can practically make is basically a matter of sensitivity, but at the operational rather than the 
conceptual level. 


Balanced or Unbalanced Rating Scale? 


The fixed-alternative format may be balanced or unbalanced. For example, the following 
question, which asks about parent-child decisions relating to television program watching, is a 
balanced rating scale: 


Who decides which television programs your children watch? 


Child decides all of the time. 
Child decides most of the time. 
Child and parent decide together. 


Parent decides most of the time. 
Parent decides all of the time. 


This scale is balanced because a neutral point, or point of indifference, is at the center of the scale. 

Unbalanced rating scales may be used when responses are expected to be distributed at 
one end of the scale. Unbalanced scales, such as the following one, may eliminate this type of 
“end piling”: 


Somewhat 
Satisfied 


Completely 
Satisfied 


Completely 


Dissatisfied Dissatisfied Satisfied 


Notice that there are three “satisfied” responses and only two “dissatisfied” responses above. The 
choice of a balanced or unbalanced scale generally depends on the nature of the concept or the 
researcher’s knowledge about attitudes toward the stimulus to be measured. 


Use a Scale That Forces a Choice among 
Predetermined Options? 


In many situations, a respondent has not formed an attitude toward the concept being studied 
and simply cannot provide an answer. If a forced-choice rating scale compels the respondent to 
answer, the response is merely a function of the question. If answers are not forced, the midpoint 
of the scale may be used by the respondent to indicate unawareness as well as indifference. If many 
respondents in the sample are expected to be unaware of the attitudinal object under investigation, 
this problem may be eliminated by using a non-forced-choice scale that provides a “no opinion” 
category, as in the following example: 


How does the Bank of Commerce compare with the First National Bank? 


Bank of Commerce is better than First National Bank. 

Bank of Commerce is about the same as First National Bank. 
Bank of Commerce is worse than First National Bank. 

Can’t say. 


Asking this type of question allows the investigator to separate respondents who cannot make 
an honest comparison from respondents who have had experience with both banks. The argument 
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e Attitudes are widely used in research e Single items can be used when concepts are very simple. In 

because they are very diagnostic— these cases, the meaning of the concept should be indisput- 

meaning that weaknesses in firm per- able. As meanings become less simple, multiple item mea- 

formance can be easily linked to a lower sures should be used. 

attitude score. e Most often, psychological concepts involve multiple item 
e Rating scales are preferable to ranking scales in measurement. 


most situations. 

e Ranking scales have a problem in that the last 
category ranked is determined by the ranking 
of the other categories. 


for forced choice is that people really do have attitudes, even if they are unfamiliar with the banks, 
and should be required to answer the question. Still, the use of forced-choice questions is asso- 
ciated with higher incidences of “no answer.” Internet surveys make forced-choice questions 
easy to implement because the delivery can be set up so that a respondent cannot go to the next 
question until the previous question is answered. Realize, however, if a respondent truly has no 
opinion, and the no opinion option is not included, he or she may simply quit responding to the 
questionnaire. 


Single Measure or an Index Measure? 


Whether to use a single measure or an index measure depends on the complexity of the issue to be 
investigated, the number of dimensions the issue contains, and whether individual attributes of the 
stimulus are part of a holistic attitude or are seen as separate items. Very simple concepts that do 
not vary from context to context can be measured by single items. However, most psychological 
concepts are more complex and require multiple-item measurement. Additionally, multiple-item 
measures are easier to test for construct validity (discussed in later chapters). The researcher’s con- 
ceptual definition will be helpful in making this choice. 

The researcher has many scaling options. Generally, the choice is influenced by plans for the 
later stages of the research project. Again, problem definition becomes a determining factor influ- 
encing the research design. 


Summary 


1. Describe how business researchers think of attitudes. Attitudes are enduring dispositions 
to consistently respond in a given manner to various aspects of the world, including persons, 
events, and objects. Attitudes consist of three components: the affective, or the emotions or 
feelings involved; the cognitive, or awareness or knowledge; and the behavioral, or the pre- 
disposition to action. Attitudes are latent constructs and because of this, they are not directly 
observable. 


2. Identify basic approaches to measuring attitudes. Many methods for measuring attitudes have 
been developed for attitude measurement. Most fall into the categories of ranking, rating, sorting, 
and choice techniques. 


3. Discuss the use of rating scales for measuring attitudes. One class of rating scales, category 
scales, provides several response categories to allow respondents to indicate the intensity of their 
attitudes. The Likert scale uses a series of statements with which subjects indicate agreement or 
disagreement. The levels of agreement with some statement are assigned numerical scores. A 
semantic differential uses a series of attitude scales anchored by bipolar adjectives. The respondent 
indicates where his or her attitude falls between the polar attitudes. Variations on this method, 
such as numerical scales and the Stapel scale, are also used. The Stapel scale puts a single adjec- 
tive in the center of a range of numerical values from +3 to —3. Constant-sum scales require 
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the respondent to divide a constant sum into parts, indicating the weights to be given to various 
attributes of the item being studied. 


4. Represent a latent construct by constructing a summated scale. Researchers use composite 
scales to represent latent constructs. An easy way to create a composite scale is to add the responses 
to multiple items together to form a total. Thus, a respondent’s scores to four items can be simply 
added together to form a summated scale. The researcher must check to make sure that each 
scale item is worded positively, or at least all in the same direction. For example, if multiple 
items are used to form a satisfaction construct, a higher score for each item should lead to higher 
satisfaction. If one of the items represents dissatisfaction, such that a higher score represents lower 
satisfaction, this item must be reverse recoded prior to creating the composite scale. 


5. Summarize ways to measure attitudes with ranking and sorting techniques. People often rank 
order their preferences. Thus, ordinal scales that ask respondents to rank order a set of objects or 
attributes may be developed. In the paired-comparison technique, two alternatives are paired and 
respondents are asked to pick the preferred one. Sorting requires respondents to indicate their 
attitudes by arranging items into piles or categories. 


6. Discuss major issues involved in the selection of a measurement scale. The researcher can 
choose among a number of attitude scales. Choosing among the alternatives requires considering 
several questions, each of which is generally answered by comparing the advantages of each alter- 
native to the problem definition. A monadic rating scale asks about a single concept. A comparative 
rating scale asks a respondent to rate a concept in comparison with a benchmark used as a frame of 
reference. Scales may be balanced or unbalanced. Unbalanced scales may prevent responses from 
piling up at one end. Forced-choice scales require the respondent to select an alternative; non- 
forced-choice scales allow the respondent to indicate an inability to select an alternative. 


Key Terms and Concepts 
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hypothetical constructs, 315 reverse recoding, 319 
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monadic rating scale, 329 Stapel scale, 322 

numerical scale, 322 Thurstone scale, 325 
paired comparison, 327 unbalanced rating scale, 330 


Questions for Review and Critical Thinking 


1. What is an attitude? Is there a consensus concerning its definition? Do you favor or oppose the Fair Tax Proposal? 
2. Distinguish between rating and ranking. Which is a better atti- 
tude measurement technique? Why? In Favor Opposed No Opinion 


3. Assume the researcher wanted to create a summated scale indi- 


cating a respondent’s attitude toward the trucking industry. 


What would the result be for the respondent whose response is b. How favorable are you toward the Fair Tax Proposal? 


as indicated below? 


4. How would you perform reverse recoding using statistical soft- Very Unfavorable Very Favorable 


ware like SAS or SPSS? 


5. What advantages do numerical scales have over semantic differ- c. A psychographic statement asking the respondent to circle 


ential scales? 


the appropriate response: 


6. Identify the issues a researcher should consider when choosing a I shop a lot for specials. 


measurement scale à 


7. Should a Likert scale ever be treated as though it had ordinal 


properties? 


8. In each of the following, identify the type of scale and evaluate it: 


Strongly Strongly 
Disagree Disagree Neutral Agree Agree 
1 2 3 4 5 


a. A USS. representative’s questionnaire sent to constituents: 
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9. What is the difference between a measured variable and a latent 
construct? 

10. Ifa Likert summated scale has ten scale items, do all ten 
items have to be phrased as either positive or negative state- 
ments, or can the scale contain a mix of positive and negative 
statements? 

11. Ifa semantic differential has ten scale items, should all the posi- 
tive adjectives be on the right and all the negative adjectives on 
the left? 

12. ETHICS A researcher thinks many respondents will answer “don’t 
know” or “can’t say” if these options are printed on an attitude 


Research Activity 


1. A researcher wishes to compare two hotels on the following 
attributes: 
Convenience of location 
Friendly personnel 
Value for money 
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scale along with categories indicating level of agreement. The 
researcher does not print either “don’t know” or “can’t say” on 
the questionnaire because the resulting data would be more com- 
plicated to analyze and report. Is this proper? 

13. ‘NET SRI International investigates U.S. consumers by asking 
questions about their attitudes and values. It has a Web site so 
people can VALS-type themselves. To find out your VALS 
type, go to http://www.sric-bi.com/VALS/presurvey.shtml. 


a. Design a Likert scale to accomplish this task. 
b. Design a semantic differential scale to accomplish this task. 
c. Design a graphic rating scale to accomplish this task. 


Case 14.1 Roeder-Johnson Corporation 


A decade ago, the talk in business circles was all 
about the central role of technology, especially 
the Internet, in the success of new businesses. 
Some investors seemed eager to back almost any 
start-up with “dot-com” in its name or its busi- 
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ness plan. Although the go-go investment climate 
of the 1990s seems far away, entrepreneurs still start companies 
every year, and they are still making their case to the investment 
community. What business ideas do investors like? Is high-tech 

still important? Public relations firm Roeder-Johnson Corporation, 
which specializes in start-up companies and those involved in tech- 
nology innovation, conducted an online survey into the attitudes of 
70 subjects, including venture capitalists, entrepreneurs, journalists, 
and company analysts.’ The central question was this: 


Do you believe that unique technology is crucial to the success of startup 
companies today? 

1. Rarely 

2. Occasionally 

3. Frequently 


4. Usually 

5. Always 
The remainder of the survey asked for reasons why technology is 
important to start-ups and invited comments from the respondents. 

In its news release, Roeder-Johnson reported that 91 percent of 
respondents consider technology to be important at least frequently. 
The breakdown was 39 percent frequently, 39 percent usually, and 
13 percent always. The remaining 9 percent of respondents cited 
technology as important only occasionally, and none said it is rarely 
important. 


Questions 

1. Evaluate the rating scale used for the question in this survey. 
Is it balanced? Are the category labels clear? Is the number of 
categories appropriate? 

2. Suggest three ways that Roeder-Johnson could improve this 
survey without a major cost increase. 

3. Based on the information given here, what do you think the 
research objectives for this survey might have been? Do you 
think the survey met its objectives? Explain. 


Case 14.2 Attitudes toward Technology and Lifestyle 


A marketing research company sent the attitude 
scales in Case Exhibit 14.2—1 to members of its 
consumer panel. Other questions on the question- 
naire were about ownership and/or use of com- 
puters, consumer electronic devices, satellite TV 
ownership, cellular phones, and Internet activity. 
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Questions 

1. What type of attitude scale appears in the case study? 

2. Evaluate the list of statements. Do the statements appear to 
measure a single concept? 

3. What do they appear to be measuring? 
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CASE EXHIBIT 14.2-1 Attitude Scale 


Below is a list of statements that may or may not be used to describe your attitudes toward technology and your lifestyle. Please indicate to what 
extent each statement describes your attitudes by placing an X in a box from 1 to 10, where 10 means that statement “Describes your attitudes 
completely” and a 1 means that statement “Does not describe your attitudes at all.” (X ONE BOX ACROSS FOR EACH STATEMENT.) 


Does Not Describe Describes Your 
Your Attitudes Attitudes 


At All Completely 


| like to impress people with my lifestyle. ] ] ] ] ] ] ] ] ] ] 


Technology is important to me. ] ] ] ] ] ] ] ] ] ] 


I am very competitive when it comes to my career. ] ] ] ] ] ] ] ] ] ] 


Having fun is the whole point of life. ] ] ] ] ] ] ] ] ] ] 


Family is important, but | have other interests that are just as 
important to me. ] ] ] ] ] ] ] ] ] ] 


I am constantly looking for new ways to entertain myself. ] ] ] ] ] ] ] ] ] ] 


Making a lot of money is important to me. O O O = ] ] ] ] ] ] 


| spend most of my free time doing fun stuff with my friends. ] ] ] ] ] ] ] ] ] ] 


| like to spend time learning about new technology products. ] ] ] ] ] ] ] mj ] ] 


| like to show off my taste and style. ] ] ] ] ] ] ] ] ] ] 


I like technology. ] ] ] ] ] ] ] ] ] ] 


My family is by far the most important thing in my life. ] ] ] ] ] ] ] ] ] ] 


| put a lot of time and energy into my career. ] ] ] ] ] ] ] ] ] ] 


I am very likely to purchase new technology products or services. ] ] ] ] ] ] ] ] ] ] 


| spend most of my free time working on improving myself. O m O O ] ] ] ] ] ] 


CHAPTER 15 
QUESTIONNAIRE 
DESIGN 


After studying this chapter, you should be able to 


1. Explain the significance of decisions about questionnaire 
design and wording 


2. Define alternatives for wording open-ended and fixed- 
alternative questions 


3. Summarize guidelines for questions that avoid mistakes 
in questionnaire design 


. Describe how the proper sequence of questions may improve a questionnaire 
. Discuss how to design a questionnaire layout 


. Describe criteria for pretesting and revising a questionnaire and for adapting it to 
global markets 


awn a 


Chapter Vignette: J.D. Power Asks Consumers to Get Real 


Are you driving your dream car? Most of us can't, because we 
bump up against the practical reality that we can’t pay for 
every great new feature. As car makers consider adding 

new features, they have to evaluate not only which ones 
appeal to consumers but also which ones will actually sell, 
considering their likely cost. J.D. Power and Associates 
recently addressed this issue in a survey of about seventeen 
thousand consumers." 

In the J.D. Power survey, consumers were asked whether 
they were familiar with twenty-two different emerging tech- 
nologies. Then they were asked about their interest in each 
technology, rating their interest using a scale (“definitely inter- 
ested,” “probably interested,” and so on). Next, the study indi- 
cated the likely price of each technology, and consumers were 
again asked their interest, given the price. The results ranked 
the features according to interest level, based on the percentage 
who indicated they were either definitely or probably interested 
in the feature. 

Learning price information often changed consumers’ interest 
levels. Night vision systems appealed to 72 percent of consumers, 
placing it in second place in the rankings. But when consumers 
learned the systems would likely add $1,500 to the price of a car, this 
technology dropped to a rank of 17, near the bottom. In contrast, 
HD radio ranked in sixteenth place until consumers saw a price tag 
of just $150. That price pushed the feature up to third place. Still, two 
features remained in the top five even with pricing information: run- 
flat tires and stability control. And three of the bottom-five features—a 
reconfigurable cabin, lane departure warning system, and smart 
sensing power-swing front doors—stayed in the bottom rankings. 

Automakers can use findings such as these to determine which features 
are price-sensitive and which might be appealing even at a higher price. 

The J.D. Power survey shows how extremely useful information can 
be gathered with a questionnaire. It also shows how results can differ by exactly what question is asked 
and the amount of information provided. This chapter outlines a procedure for questionnaire design, 
which addresses concerns such as the wording and order of questions and the layout of the questionnaire. 
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Introduction 


Each stage in the business research process is important and interdependent. The research ques- 
tionnaire development stage is critically important as the information provided is only as good as 
the questions asked. However, the importance of question wording is easily, and far too often, 
overlooked. 

Businesspeople who are inexperienced at research frequently believe that constructing a ques- 
tionnaire is a simple task. Amateur researchers think a short questionnaire can be written in min- 
utes. Unfortunately, newcomers who naively believe that good grammar is all a person needs to 
construct a questionnaire generally end up with useless results. Ask a bad question, get bad results. 

Good questionnaire design requires far more than correct grammar. People don’t understand 
questions just because they are grammatically correct. Respondents simply may not know what 
is being asked. They may be unaware of the business issue or topic of interest. They may confuse 
the subject with something else. The question may not mean the same thing to everyone inter- 
viewed. Finally, people may refuse to answer personal questions. Most of these problems can be 
minimized, however, if a skilled researcher composes the questionnaire. 


Questionnaire Quality and Design: 
Basic Considerations 


For a questionnaire to fulfill a researcher’s purposes, the questions must meet the basic criteria 
of relevance and accuracy. To achieve these ends, a researcher who is systematically planning a 
questionnaire’s design will be required to make several decisions—typically, but not necessarily, 
in the following order: 


What should be asked? 

How should questions be phrased? 

In what sequence should the questions be arranged? 

What questionnaire layout will best serve the research objectives? 


OL tS 


How should the questionnaire be pretested? Does the questionnaire need to be revised? 


This chapter provides guidelines for answering each question. 


What Should Be Asked? 


Certain decisions made during the early stages of the research process will influence the question- 
naire design. The preceding chapters stressed good problem definition and clear research questions. 
This leads to specific research hypotheses that, in turn, clearly indicate what must be measured. 
Different types of questions may be better at measuring certain things than are others. In addi- 
tion, the communication medium used for data collection—that is, telephone interview, personal 
interview, or self-administered questionnaire—must be determined. This decision is another for- 
ward linkage that influences the structure and content of the questionnaire. Therefore, the specific 
questions to be asked will be a function of previous decisions made in the research process. At the 
same time, the latter stages of the research process will also have an important impact on question- 
naire wording and measurement. For example, when designing the questionnaire, the researcher 
should consider the types of statistical analysis that will be conducted. 


Questionnaire Relevancy 


A questionnaire is relevant to the extent that all information collected addresses a research question 
that will help the decision maker address the current business problem. Asking a wrong question 
or an irrelevant question is a common pitfall. If the task is to pinpoint store image problems, ques- 
tions asking for political opinions are likely irrelevant. The researcher should be specific about data 
needs and have a rationale for each item requesting information. Irrelevant questions are more 
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than a nuisance because they make the survey needlessly long. In a study where two samples of the 
same group of businesses received either a one-page or a three-page questionnaire, the response 
rate was nearly twice as high for the one-page survey.’ 

Conversely, many researchers, after conducting surveys, find that they omitted some impor- 
tant questions. Therefore, when planning the questionnaire design, researchers must think about 
possible omissions. Is information on the relevant demographic and psychographic variables being 
collected? Would certain questions help clarify the answers to other questions? Will the results of 
the study provide the answer to the manager’s problem? 


Questionnaire Accuracy 


Once a researcher decides what should be asked, the criterion of accuracy becomes the primary 
concern. Accuracy means that the information is reliable and valid. While experienced researchers 
generally believe that questionnaires should use simple, understandable, unbiased, unambiguous, 
and nonurritating words, no step-by-step procedure for ensuring accuracy in question writing can 
be generalized across projects. Obtaining accurate answers from respondents depends strongly on 
the researcher’s ability to design a questionnaire that will facilitate recall and motivate respondents 
to cooperate. Respondents tend to be more cooperative when the subject of the research interests 
them. When questions are not lengthy, difficult to answer, or ego threatening, there is a higher 
probability of obtaining unbiased answers. 

Question wording and sequence also substantially influence accuracy, which can be particu- 
larly challenging when designing a survey for technical audiences. The Department of Treasury 
commissioned a survey of insurance companies to evaluate their offering of terrorism insurance as 
required by the government’s terrorism reinsurance program. But industry members complained 
that the survey misused terms such as “contract” and “high risk,” which have precise meanings for 
insurers, and asked for policy information “to date,” without specifying which date. These ques- 
tions caused confusion and left room for interpretation, calling the survey results into question.’ 


Wording Questions 


There are many ways to phrase questions, and many standard question formats have been devel- 
oped in previous research studies. This section presents a classification of question types and pro- 
vides some helpful guidelines for writing questions. 
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open-ended response 
questions 


Questions that pose some 
problem and ask respondents to 
answer in their own words. 


fixed-alternative questions 


Questions in which respondents 
are given specific, limited- 
alternative responses and asked 
to choose the one closest to their 
own viewpoint. 
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Open-Ended Response versus Fixed-Alternative Questions 


The first decision in questionnaire design is based on the amount of freedom respondents have 
in answering. Should the question be open-ended, allowing the participants freedom to choose 
their manner of response, or closed, where the participants choose their response from an already 
determined fixed set of choices? 

Open-ended response questions pose some problem or topic and ask respondents to answer in 
their own words. If the question is asked in a personal interview, the interviewer may probe for 
more information, as in the following examples: 


What names of local banks can you think of? 

What comes to mind when you look at this advertisement? 

In what way, if any, could this product be changed or improved? Id like you to tell me anything you can 
think of, no matter how minor it seems. 

What things do you like most about working for Federal Express? What do you like least? 

Why do you buy more of your clothing in Nordstrom than in other stores? 

How would you describe your supervisor’s management style? 

Please tell us how our stores can better serve your needs. 


Open-ended response questions are free-answer questions. They may be contrasted with 
fixed-alternative questions—sometimes called closed-ended questions—which give respondents spe- 
cific limited-alternative responses and ask them to choose the one closest to their own viewpoints. 
For example: 


Did you use any commercial feed or supplement for livestock or poultry in 2010? 


Yes No 


Would you say that the labor quality in Japan is higher, about the same, or not as good as it was 
10 years ago? 


Higher 


About the same 


Not as good 


Do you think the Renewable Energy Partnership Program has affected your business? 


Yes, for the better 
Not especially 


Yes, for the worse 


How much of your welding supplies do you purchase from our Tier One suppliers? 
All of it 

Most of it 

About one-half of it 

About one-quarter of it 


Less than one-quarter of it 


The Research Snapshot on the next page illustrates the use of a multifaceted survey to assess 
corporate reputation. 


USING OPEN-ENDED RESPONSE QUESTIONS 


Open-ended response questions are most beneficial when the researcher is conducting exploratory 
research, especially when the range of responses is not yet known. Respondents are free to answer 
with whatever is foremost in their minds. Such questions can be used to learn which words and 
phrases people spontaneously give to the free-response question. Such responses will reflect the 
flavor of the language that people use in talking about the issue and thus may provide guidance in 
the wording of questions and responses for follow up surveys. 

Also, open-ended response questions are valuable at the beginning of an interview. They are good 
first questions because they allow respondents to warm up to the questioning process. They are also 
good last questions for a fixed-alternative questionnaire, when a researcher can ask the respondent to 
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4A Corporate Reputations: Consumers 
= ~ Put Johnson & Johnson, Microsoft, 
and Google on Top 
To report the reputations of well-known compa- 
nies, the Wall Street Journal sponsors an annual 
research project. Harris Interactive has used the Harris Reputation 
Quotient (RQ) to assess the reputations of the 60 most visible 
companies in the U.S. since 1999. The Corporate Reputation 
Survey allows U.S. adults to provide their perceptions of 
corporations. 

The study has two phases. In the first phase, the researchers 
identified the companies that were most “visible,” meaning com- 
panies that people were most likely to think about—and there- 
fore have an attitude toward. This phase avoided the problem of 
asking individuals to rate the qualities of a company they have 
never heard of. This research used open-ended questions asking 
respondents to name two companies they felt had the best repu- 
tation and two that had the worst. The researchers determined 
the number of times each company was mentioned and selected 
the 60 named most often for the second phase of the study. 

The second phase was aimed at generating rankings of the 
corporations, so questions and answer choices needed to be 
more specific. The researchers identified six dimensions of a cor- 
porate reputation: products and services, financial performance, 
workplace environment, social responsibility, vision and leader- 
ship, and emotional appeal. Within these categories, they identi- 
fied 20 attributes, such as whether respondents would trust the 
company if they had a problem with its goods or services, and 
how sincere its corporate communications were. In an online 
survey, each respondent was asked to rate one company on all 


20 attributes. Then the respondent was invited (not required) 
to rate a second company. Each year, about 20,000 people par- 
ticipate in the study and more than 250 ratings were generated 
for each company. These responses were combined to create an 
overall rating for the company. 

The top-ranked company for each of the first seven years 
of the survey was Johnson & Johnson. On the six dimensions of 
reputation, J&J was tops in emotional appeal and its goods and 
services, and it made the top five on the other dimensions. This 
honor is more than just good publicity; J&J also was the firm 
from which the largest share of people said they would “defi- 
nitely purchase” products. However, Microsoft was named the 
top company in the 2006 study, followed by Google in 2007. In 
both years, Johnson & Johnson remained number two on the list 
of the reputations of the 60 most visible companies. 


Source: Based on Alsop, Ronald, “Ranking Corporation Reputations,” Wall Street 
Journal (December 6, 2005), http://online.wsj.com; “The Annual RQ 2007: The 
Reputations of the Most Visible 
Companies,” Harris Interactive, Inc. 
(2008), http://www.harrisinteractive. 
com/services/pubs/HI_BSC_REPORT_ 
AnnualRQ2007_Rankings.pdf; “The 
Annual RQ 2007: Methodological 
Overview,” Harris Interactive, Inc. 
(2008), http://www.harrisinteractive. 
com/services/pubs/HI_BSC_REPORT_ 
AnnualRQ2007_Methodology.pdf; 
“The 9th Annual RQ: Reputations 

of the 60 Most Visible Companies,” 
Harris Interactive, Inc. (2008), http:// 
www.harrisinteractive.com/News/ 
MediaAccess/2008/HI_BSC_REPORT_ 
AnnualRQ_USASummary07-08.pdf. 


expand in a manner that provides greater richness to the data. For example, an employee satisfaction 
survey may collect data with a series of fixed-alternative questions, then conclude with “Can you 
provide one suggestion on how our organization can enhance employee satisfaction?” 

The cost of administering open-ended response questions is substantially higher than that of 
administering fixed-alternative questions because the job of editing, coding, and analyzing the data 
is quite extensive. As each respondent’s answer is somewhat unique, there is some difficulty in 
categorizing and summarizing the answers. The process requires that an editor go over a sample of 
questions to develop a classification scheme. This scheme is then used to code all answers accord- 
ing to the classification scheme. 

Another potential disadvantage of the open-ended response question is the possibility that 
interviewer bias will influence the answer. While most interviewer instructions state that answers 
are to be recorded verbatim, rarely does even the best interviewer get every word spoken by the 
respondent. Interviewers have a tendency to take shortcuts. When this occurs, the interviewer 
may well introduce error because the final answer may reflect a combination of the respondent’s 
and interviewer’s ideas. 

In addition, articulate individuals tend to give longer answers to open-ended response questions. 
Such respondents often are better educated and from higher income groups and therefore may not 
be good representatives of the entire population. Yet, they may provide the most information. 


USING FIXED-ALTERNATIVE QUESTIONS 


In contrast, fixed-alternative questions require less interviewer skill, take less time, and are easier 
for the respondent to answer. This is because answers to closed questions are classified into 
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simple-dichotomy 
(dichotomous) question 


A fixed-alternative question 
that requires the respondent to 
choose one of two alternatives. 


determinant-choice 
question 


A fixed-alternative question 
that requires the respondent 
to choose one response from 
among multiple alternatives. 


frequency-determination 
question 


A fixed-alternative question that 
asks for an answer about general 
frequency of occurrence. 
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standardized groupings prior to data collection. Standardizing alternative responses to a question provides 
comparability of answers, which facilitates coding, tabulating, and ultimately interpreting the data. 

However, when a researcher is unaware of the potential responses to a question, fixed- 
alternative questions obviously cannot be used. If the researcher assumes what the responses 
will be, but is in fact wrong, he or she will have no way of knowing the extent to which the 
assumption was incorrect. Sometimes this type of error comes to light after the questionnaire 
has been used. Researchers found cross-cultural misunderstandings in a survey of mothers called 
the Preschooler Feeding Questionnaire. By talking to a group of African-American mothers, a 
researcher at the University of Chicago determined that they had experiences with encouraging 
children to eat more and using food to calm children, but they used different language for these 
situations than the questionnaire used, so they misinterpreted some questions.* 

Unanticipated alternatives emerge when respondents believe that closed answers do not ade- 
quately reflect their feelings. They may make comments to the interviewer or write additional 
answers on the questionnaire indicating that the exploratory research did not yield a complete array 
of responses. After the fact, little can be done to correct a closed question that does not provide the 
correct responses or enough alternatives. Therefore, a researcher may find exploratory research with 
open-ended responses valuable before writing a descriptive questionnaire. The researcher should 
strive to ensure that there are sufficient response choices to include almost all possible answers. 

Respondents may check off obvious alternatives, such as salary or health benefits in an employee 
survey, if they do not see opportunities for advancement, the choice they would prefer. Also, a fixed- 
alternative question may tempt respondents to check an answer that is more prestigious or socially 
acceptable than the true answer. Rather than stating that they do not know why they chose a 
given product, they may select an alternative among those presented, or as a matter of conve- 
nience, they may select a given alternative rather than think of the most correct response. 

Most questionnaires mix open-ended and closed questions. As we have discussed, each form has 
unique benefits. In addition, a change of pace can eliminate respondent boredom and fatigue. 


Types of Fixed-Alternative Questions 


Earlier in the chapter a variety of fixed-alternative questions were presented. Here we identify and 
categorize the various types. 

The simple-dichotomy (dichotomous) question requires the respondent to choose one of two 
alternatives. The answer can be a simple “yes” or “no” or a choice between “this” and “that.” 
For example: 


Did you have any overnight travel for work-related activities last month? 


Yes No 


Several types of questions provide the respondent with multiple-choice alternatives. The 
determinant-choice question requires the respondent to choose one—and only one—response 
from among several possible alternatives. For example: 


Please give us some information about your flight. In which section of the aircraft did you sit? 


First class 


Business class 


Coach class 


The frequency-determination question is a determinant-choice question that asks for an answer 
about the general frequency of occurrence. For example: 


How frequently do you watch MTV? 


Every day 


5—6 times a week 


2—4 times a week 


Once a week 


Less than once a week 


Never 
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Attitude rating scales, such as the Likert scale, semantic differential, Stapel scale, and so on, are 
also fixed-alternative questions. These scales were discussed in Chapter 14. 

The checklist question allows the respondent to provide multiple answers to a single question. 
The respondent indicates past experience, preference, and the like merely by checking off items. 
In many cases the choices are adjectives that describe a particular object. A typical checklist ques- 
tion might ask the following: 


Please check which, if any, of the following sources of information about investments you regularly use. 


Personal advice of your broker(s) 
Brokerage newsletters 


Brokerage research reports 


Investment advisory service(s) 


Conversations with other investors 
Web page(s) 

None of these 

Other (please specify) 


A major problem in developing dichotomous or multiple-choice alternatives is establishing the 
response alternatives. Alternatives should be totally exhaustive, meaning that all the response options 
are covered and that every respondent has an alternative to check. The alternatives should also be 
mutually exclusive, meaning there should be no overlap among categories and only one dimen- 
sion of an issue should be related to each alternative. So, there is a response category for everyone, 
but only a single response category for each individual. In other words, a place for everything and 
everything in its place! The following listing of income groups illustrates common errors: 


$10, 000-—$30, 000 
$30, 000-$50, 000 
$50, 000-$70, 000 
$70, 000-$90, 000 
$90, 000-$110, 000 
Over $110,000 


Which category would a respondent with an annual income of $30,000 check? How many people 
with incomes of $30,000 will be in the second group, and how many will be in the third group? 
Researchers have no way to determine the answer. This is an example of failing to have mutually 
exclusive response categories. The question also is not totally exhaustive, as there is no category for 
those earning less than $10,000 to check. Also, few people relish being in the lowest category. To 
negate the potential bias caused by respondents’ tendency to avoid an extreme category, research- 
ers often include a category lower than the lowest expected answers. The following response 
categories address the totally exhaustive and mutually exclusive issues. 


Less than $10,000 
$10, 000-$29, 999 
$30, 000-$49, 999 
$50, 000-$69, 999 
$70, 000-$89, 999 
$90, 000-$109, 999 
Over $110,000 


While this example makes the totally exhaustive and mutually exclusive categories rather 
clear, it can actually become quite challenging. Consider the preceding frequency-determination 
question regarding MTV. With a question such as this, it can become difficult to establish response 
categories that meet these rules. 


Phrasing Questions for Self-Administered, 
Telephone, and Personal Interview Surveys 


The means of data collection—telephone interview, personal interview, self-administered 
questionnaire—will influence the question format and question phrasing. In general, questions for 
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checklist question 


A fixed-alternative question that 
allows the respondent to provide 
multiple answers to a single 
question by checking off items. 


totally exhaustive 


A category exists for every 
respondent in among the fixed- 
alternative categories 


mutually exclusive 


No overlap exists among the 
fixed-alternative categories 
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Reducing Question 
Complexity by Providing 
Fewer Responses for 
Telephone Interviews 


Part 4: Measurement Concepts 


telephone in particular, as well as Internet and mail surveys, must be less complex than those used 
in personal interviews. Questionnaires for telephone and personal interviews should be written 
in a conversational style. It is particularly important that telephone surveys use easy to under- 
stand response categories. Exhibit 15.1 illustrates how a question may be revised for a different 
medium. 


Mail Form: 


How satisfied are you with your community? 


Very satisfied 

Quite satisfied 

Somewhat satisfied 

Slightly satisfied 

Neither satisfied nor dissatisfied 
Slightly dissatisfied 

Somewhat dissatisfied 

Quite dissatisfied 

Very dissatisfied 


WOANAUNUAWHN — 


Revised for Telephone: 


How satisfied are you with your community? Would you say you are very satisfied, somewhat satisfied, 
neither satisfied nor dissatisfied, somewhat dissatisfied, or very dissatisfied? 


Very satisfied 

Somewhat satisfied 

Neither satisfied nor dissatisfied 
Somewhat dissatisfied 

Very dissatisfied 


UAWN- 


Source: Dillman, Don A., Mail and Telephone Surveys: The Total Design Method (New York: John Wiley & Sons, 1978), p. 209. 
Reprinted with permission. 


In a telephone survey about attitudes toward police services, the questionnaire not only asked 
about general attitudes such as how much respondents trust their local police officers and whether 
the police are “approachable,” “dedicated,” and so on, but also provided basic scenarios to help 
respondents put their expectations into words. For example, the interviewer asked respondents 
to imagine that someone had broken into their home and stolen items, and that the respondent 
called the police to report the crime. The interviewer asked how quickly or slowly the respondent 
expected the police to arrive." 

When a question is read aloud, remembering the alternative choices can be difficult. Consider 
the following question from a personal interview: 


There has been a lot of discussion about the potential health risks to nonsmokers from tobacco smoke in 
public buildings, restaurants, and business offices. How serious a health threat to you personally is the 
inhaling of this secondhand smoke, often called passive smoking: Is it a very serious health threat, some- 
what serious, not too serious, or not serious at all? 


Very serious 
Somewhat serious 
Not too serious 


ie: os 


Not serious at all 
5. (Don’t know) 


The last portion of the question was a listing of the four alternatives that serve as answers. This 
listing at the end is often used in interviews to remind the respondent of the alternatives, since 
they are not presented visually. The fifth alternative, “Don’t know,” is in parentheses because, 
although the interviewer knows it is an acceptable answer, it is not read. The researcher only uses 
this response when the respondent truly cannot provide an answer. 

The data collection technique also influences the layout of the questionnaire. Layout will be 
discussed later in the chapter. 
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A What to Do with 
“the Clubhouse? 

Mathematician Jennifer Lewis Priestley 
helps the managers of golf and country clubs col- 
lect and interpret data. One club showed her a 
member survey containing the following question: 


We need to make some decisions about our clubhouse. The club- 
house itself is too small and requires substantial physical improve- 
ment, and it’s been a long time since we undertook a major 
redecorating project. Do you favor 


a. remodeling the current clubhouse? 
b. building a new clubhouse? 
c. doing nothing? 


The wording of the question and the answer choices are biased 
in favor of action. The question criticizes the current clubhouse 
and places the question in the context of “a long time since 
we undertook a major redecorating project.” To select choice 


c, the respondent would have to disregard the premise of the 
question. 

To eliminate the bias and include neutral wording so that the 
responses could more accurately represent the members’ opin- 
ions, Priestley recommended some changes: 


Considering the current clubhouse, which of the following state- 
ments most closely reflects your views? 


a. The current clubhouse should remain the same. 

b. The current clubhouse should be remodeled (size will remain the 
same). 

c. The current clubhouse should be remodeled and expanded. 

d. The club needs a new clubhouse (current clubhouse torn down). 


Source: Based on Priestley, Jennifer 
Lewis, “Determining What Your 
Marketing Members Want,” Club 
Management (October 2004), http:// 
infotrac.galegroup.com. 


Guidelines for Constructing Questions 


Developing good business research questionnaires is a combination of art and science. Few hard- 


and-fast rules exist in guiding the development of a questionnaire. Fortunately, research experience 


has yielded some guidelines that help prevent the most common mistakes. The Research Snapshot 


above illustrates problems with question wording in a simple descriptive research project. 


Avoid Complexity: Use Simple, Conversational Language 


Words used in questionnaires should be readily understandable to all respondents. The researcher 
usually has the difficult task of adopting the conversational language of people at the lower educa- 


tion levels without talking down to better-educated respondents. Remember, not all people have 


the vocabulary of a college graduate. In fact, in the U.S., less than 25 percent of the population 


has a bachelor’s degree. 


Respondents can probably tell an interviewer whether they are married, single, divorced, 


separated, or widowed, but providing their marital status may present a problem. The technical 


jargon of top corporate executives should be avoided when surveying retailers or industrial users. 


29 ce 2 ee ? 


“Brand image,” “positioning,” “marginal analysis,’ 


and other corporate language may not have 


the same meaning for, or even be understood by, a store owner-operator in a retail survey. The 


vocabulary used in the following question from an attitude survey on social problems probably 


would confuse many respondents: 


When effluents from a paper mill can be drunk and exhaust from factory smokestacks can be breathed, 


then humankind will have done a good job in saving the environment. . . . Don’t you agree that what 


we want is zero toxicity: no effluents? 


Besides being too long and confusing, this question is leading. Survey questions should be short 


and to the point. Like this: 


The stock market is too risky to invest in these days. 


—David Ogilvy 
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leading question 


A question that suggests or 
implies certain answers. 


loaded question 


A question that suggests a 
socially desirable answer or is 
emotionally charged. 
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Avoid Leading and Loaded Questions 


Leading and loaded questions are a major source of bias in question wording. A leading question 
suggests or implies certain answers. A study of the dry cleaning industry asked this question: 


Many people are using dry cleaning less because of improved wash-and-wear clothes. How do you feel 
wash-and-wear clothes have affected your use of dry cleaning facilities in the past 4 years? 


Use less No change Use more 


It should be clear that this question leads the respondent to report lower usage of dry cleaning. The 
potential “bandwagon effect” implied in this question threatens the study’s validity. Partial mention 
of alternatives is a variation of this phenomenon: 


Do accounting graduates who attended state universities, such as Washington State University, make 
better auditors? 


A loaded question suggests a socially desirable answer or is emotionally charged. Consider the fol- 
lowing question from a survey about media influence on politics: 


What most influences your vote in major elections? 


My own informed opinion 
Major media outlets such as CNN 
Newspaper endorsements 


Popular celebrity opinions 


Candidate’s physical attractiveness 


Family or friends 
Video advertising (television or Web video) 
Other 


The vast majority of respondents chose the first alternative. Although this question is not 
overly emotionally loaded, many people could be reluctant to say they are swayed by the media 
or advertising as opposed to their independent mindset. In fact, a research question dealing with 
what influences decisions like these may best be done by drawing some inference based on less 
direct questioning. 

Certain answers to questions are more socially desirable than others. For example, a truthful 
answer to the following classification question might be painful: 


Where did you rank academically in your high school graduating class? 


Top quarter 


2nd quarter 


3rd quarter 


4th quarter 


When taking personality or psychographic tests, respondents frequently can interpret which 
answers are most socially acceptable even if those answers do not portray their true feelings. For exam- 


ple, which are the socially desirable answers to the following questions on a self-confidence scale? 


I feel capable of handling myself in most social situations. 


Agree Disagree 


I fear my actions will cause others to have low opinions of me. 


Agree Disagree 


Invoking the status quo is a form of loading that results in bias because most people tend to 


resist change.” An experiment conducted in the early days of polling illustrates the unpopularity 
of change.” Comparable samples of respondents were simultaneously asked two questions about 
presidential succession. One sample was asked: 


Would you favor or oppose adding a law to the Constitution preventing a president from succeeding 
himself more than once? 
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The other sample was asked: 


Would you favor or oppose changing the Constitution in order to prevent a president from succeeding 
himself more than once? 


About half of respondents answered negatively to the first question. For the second question, 
about two out of three respondents answered negatively. Thus, the public would rather add to 
than change the Constitution. 

The field of political research is fraught with bias. Consider the question asked by the National 
Republican Senatorial Committee (www.nrsc.org) on a survey: 


Should foreign terrorists caught in the future or currently being held in U.S. detainment facilities be given 
the same legal rights and privileges as U.S. Citizens? 


Clearly, the authors are asking for a “No” response. A pro-Democrat pollster might word the 
y g P P P g 
question something like this:’ 


Do you believe it is acceptable for the United States to detain potentially innocent battlefield detainees 
without legal representation and to inhumanely interrogate them by means that violate the Geneva Con- 
vention and the United Nations Convention against torture? 


Obviously, this question is likewise biased toward a no response. 
A more straightforward question might ask: 


Does the presumption of innocence apply to suspected enemy combatants? 


Asking respondents “how often” they use a product or visit a store leads them to generalize 
about their habits, because there usually is some variance in their behavior. In generalizing, a person 
is likely to portray an ideal behavior rather than an average behavior. For instance, brushing your 
teeth after each meal may be ideal, but busy people may skip a brushing or two. An introductory 
counterbiasing statement or preamble to a question that reassures respondents that their ““embarrass- 
ing” behavior is not abnormal may yield truthful responses: 


Some people have time to brush three times daily but others do not. How often did you brush your teeth 
yesterday? 


If a question embarrasses the respondent, it may elicit no answer or a biased response. This is par- 
ticularly true with respect to personal or classification data such as income or education. The problem 
may be mitigated by introducing the section of the questionnaire with a statement such as this: 


To help classify your answers, we'd like to ask you a few questions. Again, your answers will be kept in 
strict confidence. 


A question statement may be leading because it is phrased to reflect either the negative or the 
positive aspects of an issue. To control for this bias, the wording of attitudinal questions may be 
reversed for 50 percent of the sample. This split-ballot technique is used with the expectation that 
two alternative phrasings of the same question will yield a more accurate total response than will 
a single phrasing. For example, in a study on small-car buying behavior, one-half of a sample of 
imported-car purchasers received a questionnaire in which they were asked to agree or disagree 
with the statement “Small U.S. cars are cheaper to maintain than small imported cars.” The 
other half of the import-car owners received a questionnaire in which the statement read “Small 
imported cars are cheaper to maintain than small U.S. cars.” 

All of these illustrations are meant as examples of one questionnaire flaw, writing questions in 
a manner that leads participants to respond in a way that does not accurately reflect their feelings, 
attitudes, or behaviors. The business researcher should read all the questions and insure that each 
does not contain bias. 


Avoid Ambiguity: Be as Specific as Possible 


Items on questionnaires often are ambiguous because they are too general. Consider such indefi- 
nite words as often, occasionally, regularly, frequently, many, good, and poor. Each of these words has 
many different meanings. For one consumer, frequent reading of Fortune magazine may be reading 
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counterbiasing statement 


An introductory statement or 
preamble to a potentially embar- 
rassing question that reduces 

a respondent's reluctance to 
answer by suggesting that cer- 
tain behavior is not unusual. 


split-ballot technique 


Using two alternative phrasings 
of the same question for respec- 
tive halves of a sample to elicit 
a more accurate total response 
than would a single phrasing. 
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double-barreled question 


A question that may induce bias 
because it covers two issues 
at once. 
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all 25 issues in a year, while another might think 12, or even 6 issues a year is frequent. Earlier, we 
used the following question as an example of a checklist question: 


Please check which, if any, of the following sources of information about investments you regularly use. 


What exactly does regularly mean? It can certainly vary from respondent to respondent. How 
exactly does hardly any differ from occasionally? Where is the cutoff? It is much better to use specific 
time periods whenever possible. 

A brewing industry study on point-of-purchase advertising (store displays) asked their 
distributors: 


How often does the company shut down production for sanitary maintenance? 


Annually (once a year) 


Semiannually (once every six months) 


Quarterly (about every three months) 


At least once monthly 


Less frequently (less often than once a year) 


Here the researchers clarified the terms permanent, semipermanent, and temporary by defining 
them for the respondent. However, the question remained somewhat ambiguous. Beer marketers 
often use a variety of point-of-purchase devices to serve different purposes—in this case, what is 
the purpose? In addition, analysis was difficult because respondents were merely asked to indicate 
a preference rather than a degree of preference. Thus, the meaning of a question may not be clear 
because the frame of reference is inadequate for interpreting the context of the question. 

A student research group asked this question: 


What media do you rely on most? 


Television 
Radio 
Internet 


Newspapers 


This question is ambiguous because it does not provide information about the context. “Rely 
on most” for what—news, sports, entertainment? When—while getting dressed in the morning, 
driving to work, at home in the evening? Knowing the specific circumstance can affect the choice 
made. 

Each of these examples shows how a question can be ambiguous and interpreted differently 
by different individuals. While we might not be able to completely eliminate ambiguity, by using 
words or descriptions that have universal meaning, replacing terms with specific response catego- 
ries, and defining the situation surrounding the question, we can improve our business research 
questionnaires. 


Avoid Double-Barreled Items 


A question covering several issues at once is referred to as a double-barreled question and should 
always be avoided. Making the mistake of asking two questions rather than one is easy—for exam- 
ple, “Do you feel our hospital emergency room waiting area is clean and comfortable?” What 
do we learn from this question? If the respondent responds positively, we could likely infer that 
our waiting area is clean and comfortable. However, if the response is negative, is it because the 
room is not clean, or not comfortable? Or both? Certainly for a manger to make improvements it 
is important to know which element needs attention. When multiple questions are asked in one 
question, the results may be exceedingly difficult to interpret. 

One of the questions we presented earlier when discussing fixed-alternative questions pro- 
vides a good example of a double-barreled question: 


Did your plant use any commercial feed or supplement for livestock or poultry in 2010? 


Yes No 
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Here, the question could actually be thought of as a “double-double-barreled” question. Both 
commercial feed or supplement and livestock or poultry are double barreled. Interpreting the answer to 
this question would be challenging. 

The following comment offers good advice regarding double-barreled questions: 


Generally speaking, it is hard enough to get answers to one idea at a time without complicating the prob- 
lem by asking what amounts to two questions at once. If two ideas are to be explored, they deserve at least 
two questions. Since question marks are not rationed, there is little excuse for the needless confusion that 
results [from] the double-barreled question.'® 


A researcher is well served to carefully examine any survey question that includes the words and 
or or. While sometimes words such as these may be used to reinforce or clarify a question, they 
are often a sign of a double-barreled question. If you have two (or three) questions, ask them 
separately, not all together. 


Avoid Making Assumptions 


Consider the following question: 


Should General Electric continue to pay its outstanding quarterly dividends? 


Yes No 


This question has a built-in assumption: that people believe the dividends paid by General Electric 
are outstanding. By answering “yes,” the respondent implies that the program is, in fact, outstand- 
ing and that things are fine just as they are. When a respondent answers “no,” he or she implies 
that GE should discontinue the dividends. The researchers should not place the respondent in that 
sort of bind by including an implicit assumption in the question. 

Another frequent mistake is assuming that the respondent had previously thought about an 
issue. For example, the following question appeared in a survey concerning Jack-in-the-Box: “Do 
you think Jack-in-the-Box restaurants should consider changing their name?” Respondents have 
not likely thought about this question beforehand. Most respondents answered the question even 
though they had no prior opinion concerning the name change. Research that induces people to 
express attitudes on subjects they do not ordinarily think about is rather meaningless. 


Avoid Burdensome Questions That May 
Tax the Respondent’s Memory 


A simple fact of human life is that people forget. Researchers writing questions about past behavior 
or events should recognize that certain questions may make serious demands on the respondent’s 
memory. Writing questions about prior events requires a conscientious attempt to minimize the 
problems associated with forgetting. 

In many situations, respondents cannot recall the answer to a question. For example, a tele- 
phone survey conducted during the 24-hour period following the airing of the Super Bowl might 
establish whether the respondent watched the Super Bowl and then ask, “Do you recall any com- 
mercials on that program?” If the answer is positive, the interviewer might ask, “What brands 
were advertised?” These two questions measure unaided recall, because they give the respondent 
no clue as to the brand of interest. 

If the researcher suspects that the respondent may have forgotten the answer to a question, he 
or she may rewrite the question in an aided-recall format—that is, in a format that provides a clue 
to help jog the respondent’s memory. For instance, the question about an advertised beer in an 
aided-recall format might be “Do you recall whether there was a brand of beer advertised on that 
program?” or “I am going to read you a list of beer brand names. Can you pick out the name of 
the beer that was advertised on the program?” While aided recall is not as strong a test of attention 
or memory as unaided recall, it is less taxing to the respondent’s memory. 

Telescoping and squishing are two additional consequences of respondents’ forgetting the 
exact details of their behavior. Telescoping error occurs when respondents believe that past events 
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—Lewis Carroll, Alice’s 
Adventures in Wonderland 
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happened more recently than they actually did. For instance, most people will estimate that they 
have changed the oil in their car more recently than they actually have. The opposite effect, 
squishing error, occurs when respondents think that recent events took place longer ago than they 
really did. A solution to this problem may be to refer to a specific event that is memorable—for 
example, “How often have you gone to a sporting event since the World Series?” Because forget- 
ting tends to increase over time, the question may concern a recent period: “How often did you 
watch HBO on cable television last week?” During pretesting or the questionnaire editing stage, 
the most appropriate time period can be determined. 

In situations in which “I don’t know” or “I can’t recall” is a meaningful answer, simply 
including a “don’t know” response category may solve the question writer’s problem. 


Make Certain Questions Generate Variance 


We want our variables to vary! It is important that the response categories provided cover the 
breadth of possibilities (totally exhaustive), but also critical that they yield variance across respon- 
dents. In many ways, if all of the respondents check the same box, we have not generated usable 
information. 

For example, the U.S. census uses the following age categories: 


Under 5 years 
5 to9 years 
10 to 14 years 
15 to 19 years 
20 to 24 years 
25 to 29 years 


95 to 99 years 

100 years and over 
While these five-year age categories do capture the range of ages and provide rather detailed 
census information regarding the general population, what would happen if they were used for 
a survey of undergraduate students? In many institutions, 95 percent or more of the respondents 
would fall into two groups. What might be more appropriate and provide better information in a 
study of undergraduates? 

When we discussed measurement issues in Chapter 13, we noted that there were benefits 
from constructing scaled responses with a larger number of response categories rather than fewer. 
In general, this is a good rule, with seven- or ten-point scales likely providing greater variance 
than three- or four-point scales. In practice, it is also often better to use a scaled response than a 
dichotomous response form. For example, our earlier example of a simple-dichotomy (dichoto- 
mous) question asked: 


Did you have any overnight travel for work-related activities last month? 


Yes No 


While the respondent could likely answer this question and we may simply desire to place 
respondents into either the “did travel” or “did not travel” category, we really do not gain much 
information from this question. It fails to discriminate at all between employees that travel once 
a month, twice a month, or were gone for 25 days last month. It is likely that these employees 
have different attitudes and needs regarding business travel. A better approach might be to create 
multiple categories (0, 1-5, 6—10, 11—15, 16—20, 21-25, 26+ nights) or ask for a specific number 
of nights away on business travel. From this, we could always recode the respondents into the 


nominal data categories of yes/no if needed. However, if we collect yes/do data to begin with, 
we cannot make more detailed distinctions later. 

In other situations, we might need to change the wording of a question to increase variance. 
If we were using a Likert scale (Strongly Disagree to Strongly Agree), it might be better to ask the 


Chapter 15: Questionnaire Design 


customer to respond to the statement “Edward Jones provides excellent advice for investors” rather 
than “Edward Jones provides good advice for investors.” The point is not to generate a specific 
score, but to create variance which allows us to examine investors with different attitudes. 

It is important for our questions to generate variance. In a perfect world, our questions would 
result in something close to a normal distribution. 


What Is the Best Question Sequence? 


The order of questions, or the question sequence, may serve several functions for the researcher. 
If the opening questions are interesting, simple to comprehend and easy to answer, respondents’ 
cooperation and involvement can be maintained throughout the questionnaire. Asking easy-to- 
answer questions teaches respondents their role and builds their confidence. 

A mail survey among department store buyers drew an extremely poor return rate. A substan- 
tial improvement in response rate occurred, however, when researchers added some introductory 
questions seeking opinions on pending legislation of great importance to these buyers. Respon- 
dents continued on to complete all the questions, not only those in the opening section. 

In their attempt to “warm up” respondents toward the questionnaire, student researchers fre- 
quently ask demographic or classification questions at the beginning of the survey. This generally 
is not advisable, because asking for personal information such as income level or education may 
embarrass or threaten respondents. Asking these questions at the end of the questionnaire usually 
is better, after rapport has been established between respondent and interviewer. 

Order bias can result from a particular answer’s position in a set of answers or from the sequencing 
of questions. In political elections in which candidates lack high visibility, such as elections for county 
commissioners and judges, the first name listed on the ballot often receives the highest percentage of 
votes. For this reason, many election boards print several ballots so that each candidate’s name appears 
in every possible position on the ballot. 

Order bias can also distort survey results. For example, suppose a questionnaire’s purpose is to 
measure levels of awareness of several charitable organizations. If Big Brothers and Big Sisters is 
always mentioned first, the American Red Cross second, and the American Cancer Society third, 
Big Brothers and Big Sisters may receive an artificially high awareness rating because respondents 
are prone to yea-saying (by indicating awareness of the first item in the list). 

Asking specific questions before asking about broader issues is a common cause of order bias. 
For example, people who are first asked, “Are you satisfied with your marriage?” will respond dif- 
ferently to a follow-up question that asks, “Are you satisfied with your life?” than if the questions 
are asked in the reverse order. Generally, researchers should ask general questions before specific 
questions. This procedure, known as the funnel technique, allows the researcher to understand 
the respondent’s frame of reference before asking more specific questions about the level of the 
respondent’s information and the intensity of his or her opinions. 

Consider how later answers might be biased by previous questions in this questionnaire on 
environmental pollution: 


Please consider each of the following issues. Circle the number for each that best indicates your feelings 
about the severity of that issue as an environmental problem: 


Issue Not At All A Problem Very Severe Problem 

Air pollution from automobile exhausts 1 2 3 4 5 
Air pollution from open burning 1 2 3 4 5 
Air pollution from industrial smoke 1 2 3 4 5 
Air pollution from foul odors 1 2 3 4 5 
Noise pollution from airplanes 1 2 3 4 5 
Noise pollution from cars, trucks, motorcycles 1 2 3 4 3 
Noise pollution from industry 1 2 3 4 5 


Not surprisingly, researchers found that the responses to the air pollution questions were 
highly correlated—in fact, almost identical. What if the first issue was foul odors instead of 
automobile exhaust? Do you think it would affect the remaining responses? 
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order bias 


Bias caused by the influence of 
earlier questions in a question- 
naire or by an answer's position 
in a set of answers. 


funnel technique 


Asking general questions before 
specific questions in order to 
obtain unbiased responses. 
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What Citizens (Don’t) Know about Climate Change 
Climate change as a result of global warming has frequently 
been featured in the news, especially in stories related to sci- 
ence and technology. Scientists at the Massachusetts Institute 
of Technology’s Laboratory for Energy and the Environment 
(LFEE) have dedicated themselves to researching a variety of 
approaches to slow down climate change. The scientists recog- 
nize, however, that these innovations have a cost, so their use 
will depend partly on public interest in the problem and demand 
for solutions. As a result, LFEE conducted an online survey, which 


filter question 


A question that screens out 
respondents who are not quali- 
fied to answer a second question. 


pivot question 


A filter question used to deter- 
mine which version of a second 
question will be asked. 
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technologies for mitigating climate change. 
Only three technologies—more efficient 
cars, solar energy, and nuclear energy— 
were checked by a majority of respondents. 
Seventeen percent admitted to not hearing 
about any of the technologies, a number that 
the researchers acknowledge may be too low, because some 
people might want to appear better informed than they are. 

Perhaps lack of interest is a factor as well. Another question 
gave respondents a list of 22 issues and asked them to choose 
the most important. The environment was ranked thirteenth. In 
a question asking respondents to rank the importance of specific 
environmental problems however, “global warming” was in sixth 
place, trailing water pollution, destruction of ecosystems, and 
toxic waste. 

All of these questions presented respondents with a list of 
alternatives to check. What precautions should the survey have 
taken to minimize the chance that the order of alternatives influ- 
enced respondents’ opinions that some items were familiar or 
important? 


it sent to a national panel. 
One challenge for the 
study was that before 
researchers could gauge 
citizens’ willingness to pay 
for new technologies, they 
needed to know whether 
most people were even 
aware of the energy alterna- 
tives. They asked, “Have you 
heard of or read about any 
of the following in the past 
year? Check all that apply,” 
followed by a list of ten 


Source: Based on “U.S. Public in the Dark on Climate Change Issues,” Bulletin of the 
American Meteorological Society 86, no. 6 (June 2005), http://firstsearch.oclc.org; 
Herzog, Howard J., Thomas E. Curry, David M. Reiner, and Stephen Ansolabehere, 
“Climate Change Poorly Understood, Not a High Priority, Shows MIT Public Survey,” 
Energy and Environment, (December 2004), 7-8, accessed at http://lfee.mit.edu. 


With attitude scales, there also may be an anchoring effect. The first concept measured tends 
to become a comparison point from which subsequent evaluations are made. Randomization of 
items on a questionnaire susceptible to the anchoring effect helps minimize order bias. 

A related problem is bias caused by the order of alternatives on closed questions. To avoid this 
problem, the order of these choices should be rotated if producing alternative forms of the question- 
naire 1s possible. Unfortunately, business researchers rarely print alternative questionnaires to eliminate 
problems resulting from order bias. With Internet surveys, however, reducing order bias by having 
the computer randomly order questions and/or response alternatives is quite easy. With complete ran- 
domization, question order is random and respondents see response alternatives in different positions. 

Asking a question that does not apply to the respondent or that the respondent is not qualified 
to answer may be irritating or cause a biased response because the respondent wishes to please the 
interviewer or to avoid embarrassment. Including a filter question minimizes the chance of asking 
questions that are inapplicable. Asking a human resource manager “How would you rate the third 
party administrator (TPA) of your employee health plan?” may elicit a response even though the 
organization does not utilize a TPA. The respondent may wish to please the interviewer with an 
answer. A filter question such as “Does your organization use a third party administrator (TPA) 
for your employee health plan?” followed by “If you answered Yes to the previous question, how 
would you rate your TPA on... ?” would screen out the people who are not qualified to answer. 
If embedded in the questionnaire, this would create the need for a skip question for those that did 
not use a TPA as discussed below. 

Another form of filter question, the pivot question, can be used to obtain income information 
and other data that respondents may be reluctant to provide. For example, 


“Is your total family income over or under $50,000?” IF UNDER, ASK, “Ts it over or under 
$25,000?” IF OVER, ASK, “Is it over or under $75,000?” 


— Under $25,000 
_—_$25,001-$50,000 


__$50,001-$75,000 
— Over $75,000 
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Exhibit 15.2 gives an example of a flowchart plan for a questionnaire. Structuring the order of the 
questions so that they are logical will help to ensure the respondent’s cooperation and eliminate 
confusion or indecision. The researcher maintains legitimacy by making sure that the respondent 
can comprehend the relationship between a given question (or section of the questionnaire) and 
the overall purpose of the study. Furthermore, a logical order may aid the individual’s memory. 
Informational and transitional comments explaining the logic of the questionnaire may ensure that 
the respondent continues. Here are two examples: 


We have been talking so far about general shopping habits in this city. Now Pd like you to compare two 
types of grocery stores—regular supermarkets and grocery departments in wholesale club stores. 

So that I can combine your answers with those of other plant managers who are similar to you, I 
need some personal information about you. Your answers to these questions—yjust as all of the others 
you’ve answered—are confidential, and you will never be identified individually. Thanks for your help 
so far. If you’ll answer the remaining questions, it will help me analyze all your answers. 


EXHIBIT 15.2 Flow of Questions to Determine the Level of Prompting Required to Stimulate Recall 


Source: “General Foods Corporation: Tang Instant Breakfast Drink (B); © 1978 F. Stewart DeBruicker and Harvey N. Singer, The Wharton School, University 
of Pennsylvania. Reprinted with permission. 
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multiple-grid question 


Several similar questions 
arranged in a grid format. 
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What Is the Best Layout? 


Good layout and physical attractiveness are crucial in mail, Internet, and other self-administered 
questionnaires. For different reasons, a good layout in questionnaires designed for personal and 
telephone interviews is also important. 


Traditional Questionnaires 


Exhibit 15.3 shows a page from a telephone questionnaire. The layout is neat and organized, and 
the instructions for the interviewer (all boldface capital letters) are easy to follow. The responses 
“It depends,” “Refused,” and “Don’t Know” are enclosed in a box to indicate that these answers 
are acceptable but responses from the five-point scale are preferred. 

Often rate of return can be increased by using money that might have been spent on an incen- 
tive to improve the attractiveness and quality of the questionnaire. Mail questionnaires should 
never be overcrowded. Margins should be of decent size, white space should be used to separate 
blocks of print, and the unavoidable columns of multiple boxes should be kept to a minimum. A 
question should not begin on one page and end on another page. Splitting questions may cause 
a respondent to read only part of a question, to pay less attention to answers on one of the pages, 
or to become confused. 

Questionnaires should be designed to appear as short as possible. Sometimes it is advisable 
to use a booklet form of questionnaire rather than stapling a large number of pages together. In 
situations in which it is necessary to conserve space on the questionnaire or to facilitate data entry 
or tabulation of the data, a multiple-grid layout may be used. The multiple-grid question presents 
several similar questions and corresponding response alternatives arranged in a grid format. For 
example, 


Airlines often offer special fare promotions, but they may require connecting flights. On a vacation trip, 
how often would you take a connecting flight instead of a nonstop flight if you could save $100 a ticket, 
but the connecting flight was longer? 


Never Rarely Sometimes Often Always 


Complete trip is one hour longer? 


Complete trip is two hours longer? 


Complete trip is three hours longer? 


Experienced researchers have found that the title of a questionnaire should be phrased carefully. 
In self-administered and mail questionnaires, a carefully constructed title may capture the respon- 
dent’s interest, underline the importance of the research (“Nationwide Study of Blood Donors”), 
emphasize the interesting nature of the study (“Study of Internet Usage”), appeal to the respondent’s 
ego (“Survey of Top Executives”), or emphasize the confidential nature of the study (“A Confi- 
dential Survey of Physicians”). At the same time, the researcher should take steps to ensure that the 
wording of the title will not bias the respondent in the same way that a leading question might. 

By using several forms, special instructions, and other tricks of the trade, the researcher can 
design the questionnaire to facilitate the interviewer’s job of following interconnected questions. 
Exhibits 15.4 and 15.5 on pages 354-356 illustrate portions of telephone and personal interview 
questionnaires. Note how the layout and easy-to-follow instructions for interviewers in questions 
1, 2, and 3 of Exhibit 15.4 help the interviewer follow the question sequence. 

Instructions are often capitalized or printed in bold to alert the interviewer that it may be 
necessary to proceed in a certain way. For example, if a particular answer is given, the interviewer 
or respondent may be instructed to skip certain questions or go to a special sequence of questions. 
To facilitate coding, question responses should be precoded when possible, as in Exhibit 15.4. 

Exhibit 15.5 illustrates some other useful techniques that are possible with personal interviews. 
Questions 3 and 6 instruct the interviewer to hand the respondent a card bearing a list of alterna- 
tives. Cards may help respondents grasp the intended meaning of the question and remember all 
the brand names or other items they are being asked about. Also, questions 2, 3, and 6 instruct the 
interviewer that rating of the banks will start with the bank that has been checked in red pencil on 
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Layout of a Page from a Telephone Questionnaire 


5. Now I’m going to read you some types of professions. For each one, please tell me whether you think the work that profession does, on 
balance, has a very positive impact on society, a somewhat positive impact, a somewhat negative impact, a very negative impact, or not 
much impact either way on society. First... (START AT X’D ITEM. CONTINUE DOWN AND UP THE LIST UNTIL ALL ITEMS HAVE 


BEEN READ AND RATED.) 


Some- 
Very what 
START Positive Positive 
HERE: Impact Impact 


Some- 
what 
Negative 
Impact 


Very 
Negative 
Impact 


Not 
Much 
Impact 


(DO NOT READ) 
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It 
Depends 


Refused 


Don’t 
Know 


[ ] Members of Congress i 2 
[X] Business executives il 2 
[ ] Physicians 1 2 


[ ] Political pollsters— 
that is, people who 
conduct surveys for 
public officials or political 
political candidates 1 2 


Researchers in the 

media—that is, people 

in media such as 

television, newspapers, 

magazines, and radio, 

who conduct surveys 

about issues later 

reported in the media 1 2 


— 


= 


Telemarketers—that is, 

people who sell 

products or services 

over the phone 1 2 


Used car salesmen 1 2 


= 


Market researchers— 

that is, people who 

work for commercial 

research firms who 

conduct surveys to 

see what the public 

thinks about certain 

kinds of consumer 

products or services 1 2 


= 


Biomedical researchers 1 2 


ey 


Public-opinion 

researchers—that is, 

people who work for 

commercial research 

firms who conduct 

surveys to see what 

the public thinks about 

important social issues 1 2 


i 


College and university 
professors 1 2 


[ ] Attorneys 1 2) 
[ ] Members of the clergy 1 2 


[ ] Journalists 1 z) 


Y (24) 
Y (25) 


Y (26) 


Y (27) 


Y (28) 


Y (29) 


Y (30) 


Nan (Sil) 


Y (32) 


Y (33) 


Y (34) 
Ye (635) 
Y (36) 


Y (37) 
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Telephone Questionnaire with Skip Questions 


1. Did you take the car you had checked to the Standard Auto Repair Center for repairs? 
—1 Yes (SKIPTOQ.3) —2 No 
2. (IF NO, ASK:) Did you have the repair work done? 


—1 Yes —2 No 


V Ņ 


1. Where was the repair work done? 1. Why didn’t you have the car repaired? 
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2. Why didn't you have the repair work done 


at the Standard Auto Repair Center? 


3. (IF YES TO Q. 1, ASK:) How satisfied were you with the repair work? Were you... 
—1 Very satisfied 
—2 Somewhat satisfied 
—3 Somewhat dissatisfied 
—4 Very dissatisfied 


(IF SOMEWHAT OR VERY DISSATISFIEDs) In what way were you dissatisfied? 


4. (ASK EVERYONE:) Do you ever buy gas at the 95th Street Standard Center? 
—1 Yes —2 No (SKIP TO Q. 6) 
5. (IF YES, ASK:) How often do you buy gas there? 
—1 Always 
—2 Almost always 
—3 Most of the time 
—4 Part of the time 
—5 Hardly ever 
6. Have you ever had your car washed there? 
=(NES =2 ING 
7. Have you ever had an oil change or lubrication done there? 


=U NES =2 (No) 


Source: Reprinted with permission from the Council of American Survey Research, http://www.casro.org. 


the printed questionnaire. The name of the red-checked bank is not the same on every question- 
naire. By rotating the order of the check marks, the researchers attempted to reduce order bias 
caused by respondents’ tendency to react more favorably to the first set of questions. 

Exhibit 15.6 on page 356 illustrates a series of questions that includes a skip question. Either 
skip instructions or an arrow drawn pointing to the next question informs the respondent which 


question comes next. 


Layout is extremely important when questionnaires are long or require the respondent to fill 
in a large amount of information. In many circumstances, using headings or subtitles to indicate 
groups of questions will help the respondent grasp the scope or nature of the questions to be asked. 
Thus, at a glance, the respondent can follow the logic of the questionnaire. 
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Personal Interview Questionnaire 


“Hello, my name is . l'm a Public Opinion Interviewer with Research Services, Inc. We're making an opinion 
survey about banks and banking, and I'd like to ask you...” 


1. What are the names of local banks you can think of offhand? (INTERVIEWER: List names in order mentioned.) 


em pangs 


2. Thinking now about the experiences you have had with the different banks here in Boulder, have you ever talked to or done business 
with... (INTERVIEWER: Insert name of bank checked in red below.) 


a. Are you personally acquainted with any of the employees or officers at ? 
b. (If YES) Who is that? 
c. Howlong has it been since you have been inside ? 


(INTERVIEWER: Now go back and repeat 2-2c for all other banks listed.) 


(2a and 2b) 
(2) Know Employee (2c) 

Talked Or Officer Been in Bank in: 

Yes No No Name Last Year 1-5 5-Plus No DK 
Arapahoe National Bank 1 2 1 1 2 3 4 5 
First National Bank 1 2 1 1 2 3 4 5 
Boulder National Bank 1 2 1 1 2 3 4 5 
Security Bank 1 2 1 1 2 B 4 5 
United Bank of Boulder 1 2 1 1 2 3 4 5 
National State Bank 1 2 1 1 2 3 4 5 


3. (HAND BANK RATING CARD) On this card there are a number of contrasting phrases or statements—for example, “Large” and “Small.” We'd 
like to know how you rate (NAME OF BANK CHECKED IN RED BELOW) in terms of these statements or phrases. Just for example, let's use the 
terms “fast service” and “slow service.’ If you were to rate a bank #1 on this scale, it would mean you find their service “very fast.” On the other 
hand, a 7 rating would indicate you feel their service is “very slow,’ whereas a 4 rating means you don't think of them as being either “very 
fast” or “very slow.’ Are you ready to go ahead? Good! Tell me then how you would rate (NAME OF BANK CHECKED IN RED) in terms of each of 
the phrases or statements on that card. How about (READ NEXT BANK NAME)? . . . (INTERVIEWER: Continue on until respondent has evaluated 
all six banks.) 


Arapahoe First Boulder Security United National 
National National National Bank Bank State 


Service 


ier 


Size 


Business vs. Family 
Friendliness 


Big/Small Business 


Rate of Growth 


Modernness 


SG a Pp pL & 


Leadership 
i. Loan Ease 


j. Location 


k. Hours 


|. Ownership 


m. Community 
Involvement 


National State Bank 6 
Other (Specify) 
DK/Wouldn’t 9 


(continued) 
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Personal Interview Questionnaire (continued) 


4. Suppose a friend of yours who has just moved to Boulder asked you to recommend a bank. Which local bank would you recommend? Why 
would you recommend that particular bank? 
Arapahoe National 
First National 
Boulder National 
Security Bank 
United Bank of Boulder 
National State Bank 
Other (Specify) 
DK/Wouldn't 9 


Au RWN > 


5. Which of the local banks do you think of as: (INTERVIEWER: Read red-checked item first, then read each of the other five.) 
the newcomer’s bank? —— ~ ~ 
the student's bank? 
the Personal Banker bank? 
the bank where most C.U. faculty and staff bank? 
the bank most interested in this community? 
the most progressive bank? 


6. Which of these financial institutions, if any, (HAND CARD 2) are you or any member of your immediate family who lives here in this home 
doing business with now? 
Bank 
Credit Union 
Finance Company 
Savings and Loan 
Industrial Bank 
None of these 
DK/Not sure 


NOAUBWN > 


(IF NONE, Skip to 19.) 


7. Ifa friend asked you to recommend a place where he or she could get a loan with which to buy a home, which financial institution would 
you probably recommend? (INTERVIEWER: Probe for specific name.) Why would you recommend (INSTITUTION NAMED)? 
Would Recommend: 


Wouldn't 0 
DK/Not Sure 9 


Source: Reprinted with permission from the Council of American Survey Research, http://www.casro.org. 


Example of a Skip Question 1. If you had to buy a computer tomorrow, which of the following three types of 


computers do you think you would buy? 
1 Desktop—Go to Q. 3 
2 Laptop—Go to Q. 3 


3 Palm-sized (PDA) 


2. (If “Palm-sized” on Q. 1, ask): What brand of computer do you think you would buy? 


3. What is your age? 


Internet Questionnaires 


Layout is also an important issue for questionnaires appearing on the Internet. A questionnaire on 
a Web site should be easy to use, flow logically, and have a clean look and overall feel that moti- 
vate the respondent to cooperate from start to finish. Many of the guidelines for layout of paper 
questionnaires apply to Internet questionnaires. There are, however, some important differences. 

With graphical user interface (GUI) software, the researcher can exercise control over the back- 
ground, colors, fonts, and other visual features displayed on the computer screen so as to create 
an attractive and easy-to-use interface between the computer user and the Internet survey. GUI 
software allows the researcher to design questionnaires in which respondents click on the appro- 
priate answer rather than having to type answers or codes. 
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There are a large number of Web publishing software pack- 
ages (e.g., WebSurveyor, FrontPage, etc.) and Web survey 
host sites (such aS www.zoomerang.com and www.surveymonkey.com) 
to assist a researcher with Internet data collection. However, 
several features of a respondent’s computer may influence the 
appearance of an Internet questionnaire. For example, discrep- 
ancies between the designer’s and the respondent’s computer 
settings for screen configuration (e.g., 1,024 x 768 pixels versus 
1,280 x 800 pixels) may result in questions not being fully vis- 
ible on the respondent’s screen, misaligned text, or other visual 
problems. The possibility that the questionnaire the researcher/ 
designer constructs on his or her computer may look different 
from the questionnaire that appears on the respondent’s com- 
puter should always be considered when designing Internet 
surveys. One sophisticated remedy is to use the first few ques- 
tions on an Internet survey to ask about operating system, browser software, and other computer 
configuration issues so that the questionnaire that is delivered is as compatible as possible with 
the respondent’s computer. A simpler solution is to limit the horizontal width of the questions 
to 70 characters or less, to decrease the likelihood of wrap-around text. 


LAYOUT ISSUES 


Even if the questionnaire designer’s computer and the respondents’ computers are compatible, a 
Web questionnaire designer should consider several layout issues. The first decision is whether 
the questionnaire will appear page by page, with individual questions or groups of questions on 
separate screens (Web pages), or on a scrolling basis, with the entire questionnaire appearing on 
a single Web page that the respondent scrolls from top to bottom. The paging layout (going from 
screen to screen) greatly facilitates skip patterns. Based on a respondent’s answers to filter ques- 
tions, the computer can automatically insert relevant questions on subsequent pages. If the entire 
questionnaire appears on one page (the scrolling layout), the display should advance smoothly, as if 
it were a piece of paper being moved up or down. The scrolling layout gives the respondent the 
ability to read any portion of the questionnaire at any time, but the absence of page boundaries can 
cause problems. For example, suppose a Likert scale consists of 15 statements in a grid-format lay- 
out, with the response categories Strongly Disagree, Disagree, Neutral, Agree, and Strongly Agree 
at the beginning of the questionnaire. Once the respondent has scrolled down beyond the first 
few statements, he or she may not be able to see both the statements at the end of the list and the 
response categories at the top of the grid simultaneously. Thus, avoiding the problems associated 
with splitting questions and response categories may be difficult with scrolling questionnaires. 

When a scrolling questionnaire is long, category or section headings are helpful to respondents. 
It is also a good idea to provide links to the top and bottom parts of each section, so that users can 
navigate through the questionnaire without having to scroll through the entire document." 

Whether a Web survey is page-by-page or scrolling format a push button with a label should 
clearly describe the actions to be taken. For example, if the respondent is to go to the next page, 
a large arrow labeled “NEXT” might appear in color at the bottom of the screen. 

Decisions must be made about the use of color, graphics, animation, sound, and other special 
features that the Internet makes possible. One point to remember is that, although sophisticated 
graphics are not a problem for most people with powerful computers and high speed Internet, 
many respondents’ computers and/or Internet connections are not powerful enough to deliver 
complex graphics at a satisfactory speed. 

With a paper questionnaire, the respondent knows how many questions he or she must 
answer. Because many Internet surveys offer no visual clues about the number of questions to be 
asked, it is important to provide a status bar or some other visual indicator of questionnaire length. 
For example, including a partially filled rectangular box as a visual symbol and a statement such 
as “The status bar at top right indicates approximately what portion of the survey you have com- 
pleted” increases the likelihood that the respondent will finish the entire sequence of questions. 
Exhibit 15.7 on the next page shows a question from an online survey that uses a simple and 
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Web-based software can 


generally adjust to a user’s 
browser and make for a neat 
appearance. 


push button 


In a dialog box on an Internet 
questionnaire, a small outlined 
area, such as a rectangle or an 
arrow, that the respondent clicks 
on to select an option or perform 
a function, such as submit. 


status bar 


In an Internet questionnaire, 

a visual indicator that tells the 
respondent what portion of the 
survey he or she has completed. 
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EXHIBIT 15.7 
Question in an Online 
Screening Survey for Joining 
a Consumer Panel 


radio button 


In an Internet questionnaire, a 
circular icon, resembling a but- 
ton, that activates one response 
choice and deactivates others 
when a respondent clicks on it. 


drop-down box 


In an Internet questionnaire, a 
space-saving device that reveals 
responses when they are needed 
but otherwise hides them from 
view. 


check boxes 


In an Internet questionnaire, 
small graphic boxes, next to 
answers, that a respondent clicks 
on to choose an answer; typically, 
a check mark or an X appears in 
the box when the respondent 
clicks on it. 


open-ended boxes 


In an Internet questionnaire, 
boxes where respondents can 
type in their own answers to 
open-ended questions. 


pop-up boxes 


In an Internet questionnaire, 
boxes that appear at selected 
points and contain information 
or instructions for respondents. 
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Stat Finish 


Though your plans may change, approximately when do you plan to purchase or lease your next automobile? 
Please indicate both the year and month. 


Select Year hee | | Select Month v 


©2006 J.D, Power and Associates, The McGraw-Hill Companies, Inc. All Rights Reserved, 


Source: J.D. Power and Associates, “JDPowerPanel,’ https://ia.jdpa.com/20/survey/onsurvey.phtml, accessed March 9, 2006. 


motivating design. The survey presents one question at a time for simplicity. So that respondents 
can see their progress toward the end of the questionnaire, a gauge in the upper right corner fills 
from left to right as the respondent proceeds from Start to Finish. 

An Internet questionnaire uses dialog boxes to display questions and record answers. Exhibit 15.8 
portrays four common ways of displaying questions on a computer screen. Many Internet question- 
naires require the respondent to activate his or her answer by clicking on the radio button for a 
response. Radio buttons work like push buttons on automobile radios: Clicking on an alternative 
response deactivates the first choice and replaces it with the new response. A drop-down box, such 
as the one shown in Exhibit 15.8, is a space-saving device that allows the researcher to provide a list 
of responses that are hidden from view until they are needed. A general statement, such as “Please 
select” or “Click here,” is shown initially. Clicking on the downward-facing arrow makes the full 
range of choices appear. 

Checklist questions may be followed by check boxes, several, none, or all of which may be 
checked by the respondent. Open-ended boxes are boxes in which respondents type their answers 
to open-ended questions. Open-ended boxes may be designed as one-line text boxes or scrolling text 
boxes, depending on the breadth of the expected answer. Of course, open-ended questions require 
that respondents have both the skill and the willingness to keyboard lengthy answers on the com- 
puter. Some open-ended boxes are designed so that respondents can enter numbers for frequency 
response, ranking, or rating questions. For example, 


Below you will see a series of statements that might or might not describe how you feel about your career. 
Please rate each statement using a scale from 1 to 5, where 1 means “Totally Disagree,” 2 means 
“Somewhat Disagree,” 3 means “Neither Agree nor Disagree,” 4 means “Somewhat Agree,” and 5 
means “Totally Agree.” Please enter your numeric answer in the box provided next to each statement. 
Would you say that. . . 


A lack of business knowledge relevant to my field/career could hurt my career advancement. 
My career life is an important part of how I define myself. 
I am seriously considering a change in careers. 


Pop-up boxes are message boxes that can be used to highlight important information. For 
example, pop-up boxes may be use to provide a privacy statement, such as the following: 


IBM would like your help in making our Web site easier to use and more effective. Choose to complete 
the survey now or not at all. 


Clicking on Privacy Statement opens the following pop-up box: 
Survey Privacy Statement 


This overall Privacy Statement verifies that IBM is a member of the TRUSTe program and is in compli- 
ance with TRUSTe principles. This survey is strictly for market research purposes. The information you 
provide will be used only to improve the overall content, navigation, and usability of ibm.com. 
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Radio button 


Drop-down box, 
closed position 


Drop-down box, 
open position 


Check box 


Open-ended, 
one-line box 


Open-ended, 
scrolling text box 


Last month, did you purchase products or services over the Internet? Alternative Ways of 
C Yes Displaying Internet 
Questions 
C No 
How familiar are you with Microsoft's Xbox video game player? 
Know Know Know Know Never 
Extremely Faiy a Just Heard 
Well Wel Little Name of 
Cc ©) Cc © (@) 


In which country or region do you currently reside? 
Click Here Vv 


In which country or region do you currently reside? 
Click Here {v 


United States 

Asia/Pacific (excluding Hawaii) 

Africa 

Australia or New Zealand 

Canada 

Europe 

Latin America, South America, or Mexico 
Middle East 

Other 


From which location(s) do you access the Internet? Select all that apply. 
O Home 

CO Work 

C Other Location 


Please indicate which of the following Web sites you have 
ever visited or used. (CHOOSE ALL THAT APPLY.) 
E*Trade's Web site 

Waterhouse's Web site 

Merrill Lynch's Web site 

Fidelity's Web site 

Schwab's Web site 

Powerstreet 

Yahoo! Finance 

Quicken.com 

Lycos Investing 

AOL's Personal Finance 

None of the above 


E E E E E c N N E E E 


What company do you think is the most visible sponsor of sports? 


What can we do to improve our textbook? 


E] 
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variable piping software 


Software that allows variables 

to be inserted into an Internet 
questionnaire as a respondent is 
completing it. 


error trapping 


Using software to control the 
flow of an Internet 
questionnaire—for example, 

to prevent respondents from 
backing up or failing to answer a 
question. 


forced answering software 


Software that prevents respon- 
dents from continuing with an 
Internet questionnaire if they fail 
to answer a question. 


interactive help desk 


In an Internet questionnaire, a 
live, real-time support feature 
that solves problems or answers 
questions respondents may 
encounter in completing the 
questionnaire. 
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In some cases, respondents can learn more about how to use a particular scale or get a defini- 
tion of a term by clicking on a link, which generates a pop-up box. One of the most common 
reasons for using pop-up boxes is error trapping, a topic discussed in the next section. 

Chapter 14 described graphic rating scales, which present respondents with a graphic con- 
tinuum. On the Internet, researchers can take advantage of scroll bars or other GUI software 
features to make these scales easy to use. For example, the graphic continuum may be drawn as a 
measuring rod with a plus sign on one end and a minus sign on the other. The respondent then 
moves a small rectangle back and forth between the two ends of the scale to scroll to any point 
on the continuum. Scoring, as discussed in Chapter 14, is in terms of some measure of the length 
(millimeters) from one end of the graphic continuum to the point marked by the respondent. 

Finally, researchers should include a customized thank-you page at the end of an Internet 
questionnaire, so that a brief thank-you note pops onto respondents’ screens when they click on 
the Submit push button." 


SOFTWARE THAT MAKES QUESTIONNAIRES INTERACTIVE 


Computer code can be written to make Internet questionnaires interactive and less prone to 
errors. The writing of software programs is beyond the scope of this discussion. However, several 
of the interactive functions that software makes possible should be mentioned here. 

Internet software allows the branching off of questioning into two or more different lines, 
depending on a particular respondent’s answer, and the skipping or filtering of questions. 
Questionnaire-writing software with skip and branching logic is readily available. Most of 
these programs have hidden skip logic so that respondents never see any evidence of skips. It is 
best if the questions the respondent sees flow in numerical sequence. However, some programs 
number all potential questions in numerical order, and the respondent sees only the numbers 
on the questions he or she answers. Thus, a respondent may answer questions 1 through 11 
and then next see a question numbered 15 because of the skip logic. 

Software can systematically or randomly manipulate the questions a respondent sees. 
Variable piping software allows variables, such as answers from previous questions, to be inserted 
into unfolding questions. Other software can randomly rotate the order of questions, blocks of 
questions, and response alternatives from respondent to respondent. 

Researchers can also use software to control the flow of a questionnaire. Respondents can 
be blocked from backing up, or they can be allowed to stop in mid-questionnaire and come 
back later to finish. A questionnaire can be designed so that if the respondent fails to answer a 
question or answers it with an incorrect type of response, an immediate error message appears. 
This is called error trapping. With forced answering software, respondents cannot skip over ques- 
tions as they do in mail surveys. The program will not let them continue if they fail to answer 
a question. The software may insert a boldfaced error message on the question screen or insert 
a pop-up box instructing the respondent how to continue. For example, if a respondent does 
not answer a question and tries to proceed to another screen, a pop-up box might present the 
following message: 


ou cannot leave a question blank. On questions without a ot sure” or ecline to answer” option 
Yo tl tion blank. O t thout a “Not ” or “Decline t ” option, 
please choose the response that best represents your opinions or experiences. 


The respondent must close the pop-up box and answer the question in order to proceed to the 
next screen. 

Some designers include an interactive help desk in their Web questionnaire so that respondents 
can solve problems they encounter in completing a questionnaire. A respondent might e-mail ques- 
tions to the survey help desk or get live, interactive, real-time support via an online help desk. 

Some respondents will leave the questionnaire Web site, prematurely terminating the survey. 
In many cases sending an e-mail message to these respondents at a later date, encouraging them 
to revisit the Web site, will persuade them to complete the questionnaire. Through the use of 
software and cookies, researchers can make sure that the respondent who revisits the Web site will 
be able to pick up at the point where he or she left off. 

Once an Internet questionnaire has been designed, it is important to pretest it to ensure that 
it works with Internet Explorer, Mozilla Firefox, Safari, Opera, Maxthon, and other browsers. 


| ya Pretesting the CAHPS conducted in Spanish. This process resulted in a draft survey 
SS 


Hospital Survey with 66 items. 
The federal government's Centers for Next, the 66-item survey underwent pilot testing with almost 
Medicare and Medicaid Services (CMS) is sup- 50,000 patients at hospitals in three states. Hospitals were 
posed to make information about hospital per- selected to represent a cross-section of hospital types in those 
formance available to the public so that patients can compare states. The researchers verified that a representative sample of 


hospitals and make informed choices about health-care services. the population completed the survey, and they analyzed the 

An important aspect of hospital performance is whether patients data to assess which questions best predicted satisfaction levels. 
feel satisfied with the care they receive. Many hospitals have Based on these analyses, the questionnaire was reduced to 32 
used surveys to measure patient satisfaction, but comparing hos- items. That questionnaire was tested at several more hospitals 
pitals requires that all facilities use the same survey. So, CMS has and reviewed by the National Quality Forum. Based on this 
spent several years creating and modifying a questionnaire, the feedback, seven items were deleted and then two items were 
Consumer Assessment of Health Providers and Systems (CAHPS) restored to the questionnaire. Finally, the resulting 27-item 
Hospital Survey, and similar questionnaires for other health-care survey was ready for use nationwide. 


providers. A 2 5 ; Source: Goldstein, Elizabeth, Marybeth Farquhar, Christine Crofton, Charles Darby, 
Considering that the CAHPS Hospital Survey is being made and Steven Garfinkel, “Measuring Hospital Care from the Patients’ Perspective: An 
available to all U.S. hospitals and the data will be made pu b- Overview of the CAHPS Hospital Survey Development Process,” Health Services 


Research (December 2005), http://galenet.galegroup.com; “CAHPS Surveys and Tools 
$ é ; 3 AENA to Advance Patient-Centered Care,” U.S. Department of Health and Human Services, 
extensive pretesting, with public comment invited at each stage Agency for Healthcare Research and 


lic, the researchers developing the survey have put it through 


z 

z of the process. The first version of the survey, consisting of 68 Quality (AHRQ), http://www.cahps.ahrq. 
g z i PE E gov, last updated February 28, 2006; 

© questions, was given to a sample of 18 individuals drawn from “CAHPS Survey Products,” AHRQ, http:// 
4 the general population, who were then interviewed to discuss www.cahps.ahrq.goy, last updated March 
Q A ; ; : 6, 2006; Hays, Ron D. and Julie Brown, 

a how they interpreted the questions. Based on their reactions, “Field Testing: What Itls and How We Do 
& the researchers modified the survey to make it clearer and then It,” CAHPS Connection (December 2005), 
6 tested it on 13 more people. Almost half the interviews were http://www.cahps.ahrq.gov. 
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Some general-purpose programming languages, such as Java, do not always work with all brows- 
ers. While more compatible then ever, different browsers still have different peculiarities, thus a 
survey that works perfectly well with one may not function at all with another." 


How Much Pretesting and 
Revising Are Necessary? 


Many novelists write, rewrite, revise, and rewrite again certain chapters, paragraphs, or even 
sentences. The researcher works in a similar world. Rarely—if ever—does he or she write only 
a first draft of a questionnaire. Usually the questionnaire is written, revised, shared with others 
for feedback, then revised again. After that, it is tried out on a group, selected on a convenience 
basis, that is similar in makeup to the one that ultimately will be sampled. Although the researcher 
should not select a group too divergent from the target market—for example, selecting business 
students as surrogates for businesspeople—pretesting does not require a statistical sample. The 
pretesting process allows the researcher to determine whether respondents have any difficulty 
understanding the questionnaire and whether there are any ambiguous or biased questions. This 
process is exceedingly beneficial. Making a mistake with 25 or 50 subjects can avoid the potential 
disaster of administering an invalid questionnaire to several hundred individuals. For a question- 
naire investigating teaching-students’ experience with Web-based instruction, the researcher had 
the questionnaire reviewed first by university faculty members to ensure the questions were valid, 
then asked 20 teaching students to try answering the questions and indicate any ambiguities they 
noticed. Their feedback prompted changes in the format and wording. Pretesting was especially 
helpful because the English-language questionnaire was used in a school in the United Arab 
Emirates, where English is spoken but is not the primary language.'* 
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preliminary tabulation 


A tabulation of the results of 

a pretest to help determine 
whether the questionnaire 
will meet the objectives of the 
research. 
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Tabulating the results of a pretest helps determine whether the questionnaire will meet the 
objectives of the research. A preliminary tabulation often illustrates that, although respondents can 
easily comprehend and answer a given question, that question is inappropriate because it does not 
provide relevant information to help solve the business problem. Consider the folowing example 
from a survey among distributors of power-actuated tools such as stud drivers concerning the 
percentage of sales to given industries: 


Please estimate what percentage of your fastener and load sales go to the following industries: 


— % heating, plumbing, and air conditioning 
— % carpentry 

— % electrical 

— % maintenance 


— % other (please specify) 


The researchers were fortunate to learn that asking the question in this manner made it 
virtually impossible to obtain the information actually desired. The categories are rather vague, 
a high percentage may fall into the Other category, and most respondents’ answers did not total 
100 percent. As a result, the question had to be revised. In general, getting respondents to add 
everything correctly is a difficult task, and virtually impossible if they can not see all the cat- 
egories (not a good idea for a telephone survey!). Pretesting difficult questions such as these is 
essential. 

What administrative procedures should be implemented to maximize the value of a pretest? 
Administering a questionnaire exactly as planned in the actual study often is not possible. For 
example, mailing out a questionnaire is quite expensive and might require several weeks that sim- 
ply cannot be spared. Pretesting a questionnaire in this manner would provide important informa- 
tion on response rate, but may not point out why questions were skipped or what questions are 
ambiguous or confusing. Personal interviewers can record requests for additional explanation or 
comments that indicate respondents’ difficulty with question sequence or other factors. This is the 
primary reason why interviewers are often used for pretest work. Self-administered questionnaires 
are not reworded to be personal interviews, but interviewers are instructed to observe respondents 
and ask for their comments after they complete the questionnaire. When pretesting personal or 
telephone interviews, interviewers may test alternative wordings and question sequences to deter- 
mine which format best suits the intended respondents. 

No matter how the pretest is conducted, the researcher should remember that its purpose is 
to uncover any problems that the questionnaire may cause. Thus, pretests typically are conducted 
to answer questions about the questionnaire such as the following: 


e Can the questionnaire format be followed by the interviewer? 
e Does the questionnaire flow naturally and conversationally? 

e Are the questions clear and easy to understand? 

e Can respondents answer the questions easily? 

e Which alternative forms of questions work best? 


Pretests also provide means for testing the sampling procedure—to determine, for example, 
whether interviewers are following the sampling instructions properly and whether the procedure 
is efficient. Pretests also provide estimates of the response rates for mail surveys and the completion 
rates for telephone surveys. 

Usually a questionnaire goes through several revisions. The exact number of revisions depends 
on the researcher’s and client’s judgment. The revision process usually ends when both agree that 
the desired information is being collected in an unbiased manner. 


Designing Questionnaires for Global Markets 


Now that business research is being conducted around the globe, researchers must take cultural 
factors into account when designing questionnaires. The most common problem involves trans- 
lating a questionnaire into other languages. A questionnaire developed in one country may be 
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e There must be a very close correspon- 
dence between the research objectives 
and the questions on the survey: 
e Match up each research objective or hypoth- 
esis with a question or questions on the survey. 
Similarly, match up each survey question with a 
research objective. Are you sure you will have the infor- 
mation to address the research objective and/or test 
the research hypothesis? If not, you need more ques- 
tions. If you have questions that do not link directly with 
a research objective or hypothesis, why is it included? 
Shorter surveys enhance response rates, but there is no 
benefit if you do not gather all the important information. 
Think of open-ended response questions as an essay exam; 


think of fixed-alternative questions as a multiple-choice exam. 


An essay exam can be developed in much less time than a 
multiple-choice exam, but takes much longer to grade. Simi- 
larly, an open-ended questionnaire is faster to develop, but 
takes much longer to edit, code, and interpret. 

It is important to minimize the cognitive complexity of ques- 
tions, particularly for telephone surveys. Keep the response 
categories consistent and straightforward, as it is very dif- 
ficult for the respondent to understand and remember the 
response choices when they are hearing them on the phone. 
A ten-point scale works very well in this situation. 


More sensitive or potentially embarrassing questions and the 
collection of demographic information should be at the end 
of the questionnaire. Asking these questions at the end of the 
questionnaire, after rapport has been established, enhances 
the probability of the participant responding. Do not start the 
survey with these questions. 

Always evaluate your questionnaire in regard to these issues: 

e Make certain you have totally exhaustive and mutually 
exclusive response categories. 

e Avoid technical terminology and jargon; use simple 
language. 

e Avoid leading questions. 

e Avoid ambiguity. 

e Avoid double-barreled questions; if you have two ques- 
tions, ask two separate questions, rather than roll them 
into one. 

e Avoid making assumptions of the respondents. 

e Minimize respondent cognitive load; use consistent 
measurement scales and specify time frames that are easy 
to recall. 

e Make sure variables vary; questions and response catego- 
ries should ensure that there will be a reasonable distribu- 
tion of responses. An increased number of scale points 
often helps achieve this. 


difficult to translate because equivalent language concepts do not exist or because of differences in 
idiom and vernacular. Although Spanish is spoken in both Mexico and Venezuela, one researcher 
found out that the Spanish translation of the English term retail outlet works in Mexico but not in 
Venezuela. Venezuelans interpreted the translation to refer to an electrical outlet, an outlet of a 
river into an ocean, or the passageway onto a patio. 

Counting on an international audience to speak a common language such as English does 
not necessarily bridge these gaps, even when the respondents actually do speak more than one 
language. Cultural differences incorporate many shades of meaning that may not be captured by 
a survey delivered in a language used primarily for, say, business transactions. In a test of this idea, 
undergraduate students in 24 countries completed questionnaires about attitudes toward school and 
career. Half received the questionnaire in English, and half in their native language. The results 
varied, with country-to-country differences being smaller when students completed the question- 
naire in English.'* 

International researchers often have questionnaires back translated. Back translation is the 
process of taking a questionnaire that has previously been translated from one language to 
another and having it translated back again by a second, independent translator. The back 
translator is often a person whose native tongue is the language that will be used for the 
questionnaire. This process can reveal inconsistencies between the English version and the 
translation. For example, when a soft-drink company translated its slogan “Baby, it’s cold 
inside” into Cantonese for research in Hong Kong, the result read “Small Mosquito, on the 
inside, it is very cold.” In Hong Kong, small mosquito is a colloquial expression for a small 
child. Obviously the intended meaning of the advertising message had been lost in the trans- 
lated questionnaire. '° 

Literacy rates also influences the designs of self-administered questionnaires and interviews. 
Knowledge of the literacy rates in foreign countries, especially those that are just developing mod- 
ern economies, is vital. 


back translation 


Taking a questionnaire that has 
previously been translated into 
another language and having a 
second, independent translator 
translate it back to the original 
language. 
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Summary 


1. Explain the significance of decisions about questionnaire design and wording. Good ques- 
tionnaire design is a key to obtaining accurate survey results. The specific questions to be asked 
will be a function of the type of information needed to answer the manager’s questions and the 
communication medium of data collection. Relevance and accuracy are the basic criteria for 
judging questionnaire results. A questionnaire is relevant if no unnecessary information is collected 
and the information needed for solving the business problem is obtained. Accuracy means that the 
information is reliable and valid. 


2. Define alternatives for wording open-ended and fixed-alternative questions. Knowing 
how each question should be phrased requires some knowledge of the different types of 
questions possible. Open-ended response questions pose some problem or question and ask 
the respondent to answer in his or her own words. Fixed-alternative questions require less 
interviewer skill, take less time to complete, and are easier to answer. In fixed-alternative 
questions the respondent is given specific limited alternative responses and asked to choose 
the one closest to his or her own viewpoint. Standardized responses are easier to code, 
tabulate, and interpret. Care must be taken to formulate the responses so that they do not 
overlap and cover all the possibilities. Respondents whose answers do not fit any of the fixed 
alternatives may be forced to select alternatives that do not communicate what they really 
mean. Open-ended response questions are especially useful in exploratory research or at the 
beginning or end of a questionnaire. They make a questionnaire more expensive to analyze 
because of the uniqueness of the answers. Also, interviewer bias can influence the responses 
to such questions. 


3. Summarize guidelines for questions that avoid mistakes in questionnaire design. Some guide- 
lines for questionnaire construction have emerged from research experience. The language should 
be simple to allow for variations in educational level. Researchers should avoid leading or loaded 
questions, which suggest answers to the respondents, as well as questions that induce them to give 
socially desirable answers. Respondents have a bias against questions that suggest changes in the 
status quo. Their reluctance to answer personal questions can be reduced by explaining the need 
for the questions and by assuring respondents of the confidentiality of their replies. The researcher 
should carefully avoid ambiguity in questions. Another common problem is the double-barreled 
question, which asks two questions at once. Finally, researchers need to examine the question to 
ensure that it will provide variance in responses. 


4. Describe how the proper sequence of questions may improve a questionnaire. Question 
sequence can be very important to the success of a survey. The opening questions should be 
designed to capture respondents’ interest and keep them involved. General questions should 
precede specific ones. In a series of attitude scales the first response may be used as an anchor 
for comparison with the other responses. The order of alternatives on closed questions can affect 
the results. Filter questions are useful for avoiding unnecessary questions that do not apply to 
a particular respondent. Such questions may be put into a flowchart for personal or telephone 
interviewing. Personal questions, demographics, and categorical questions should be placed at the 
end of the questionnaire. 


5. Discuss how to design a questionnaire layout. The layout of a mail or other self-administered 
questionnaire can affect its response rate. An attractive questionnaire encourages a response, as 
does a carefully phrased title. Internet questionnaires present unique design issues. Decisions must 
be made about the use of color, graphics, animation, sound, and other special layout effects that 
the Internet makes possible. 


6. Describe criteria for pretesting and revising a questionnaire and for adapting it to global 
markets. Pretesting helps reveal errors while they can still be corrected easily. A preliminary 
tabulation may show that, even if respondents understand questions, the responses are not relevant 
to the business problem. Often, the most efficient way to conduct a pretest is with interviewers to 
generate quick feedback. International business researchers must take cultural factors into account 
when designing questionnaires. The most widespread problem involves translation into another 
language. International questionnaires are often back translated to insure the original concepts are 
correctly translated. 
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Key Terms and Concepts 


back translation, 363 
check boxes, 358 
checklist question, 341 


frequency-determination question, 340 
funnel technique, 349 

interactive help desk, 360 

leading question, 344 

loaded question, 344 

multiple-grid question, 352 


pop-up boxes, 358 

preliminary tabulation, 362 
push button, 357 

radio button, 358 
sumple-dichotomy (dichotomous) 


counterbiasing statement, 345 
determinant-choice question, 340 
double-barreled question, 346 
drop-down box, 358 

error trapping, 360 


question, 340 
split-ballot technique, 345 
status bar, 357 


mutually exclusive, 341 
open-ended boxes, 358 


filter question, 350 
fixed-alternative questions, 338 
forced answering software, 360 


order bias, 349 


open-ended response questions, 338 


pivot question, 350 


totally exhaustive, 341 
variable piping software, 360 


Questions for Review and Critical Thinking 


1. Evaluate and comment on the following questions, taken from 


several questionnaires. Do they follow the rules discussed in this 


gallon. In order to provide the required data you should list the 
accumulator reading on the full-service regular gasoline pump when 


chapter? the station opens on the 1st day, the 10th day, and the 25th day of 
a. A university computer center survey on SPSS usage: the month and when the station closes on the last day of the month. 
How often do you use SPSS statistical software? Please check one. An anti-gun-control group’s survey: 
Infrequently (once a semester) Do you believe that private citizens should have the right to own 
Occasionally (once a month) firearms to defend themselves, their families, and their property from 
Frequently (once a week) violent criminal attack? 
All the time (daily) Ys — No 
b. A survey of advertising agencies: Asürver of ihe general poblic: 
Do you understand and like the Federal Trade Commission’s new In the next year, after accounting for inflation, do you think your 
corrective advertising policy? real personal income will go up or down? 
Yes ____No 1. Up 
c. A survey on a new, small electric car: 2. (Stay the same) 
3. Down 
Assuming 90 percent of your driving is in town, would you buy 4. (Don't know) 
this type of car? 
Yes No ETHICS A survey of the general public: 
f ; ico Some people say that companies should be required by law to label 
Y this type of electric foe had the same initial cost as a current all chemicals and substances that the government states are poten- 
Big 3” full-size, fully equipped car, but operated at one-half the tially harmful. The label would tell what the chemical or substance 
cost over a five-year period, would you buy one? is, what dangers it might pose, and what safety procedures should 
Yes _____No be used in handling the substance. Other people say that such laws 
dé A stusdentsiryey; would be too strict. They say the law should require labels on only 
: n : , those chemicals and substances that the companies themselves decide 
Since the beginning of this semester, approximately what percentage are potentially harmful. Such a law, they say, would be less costly 
of the nme do you get to campus using each of the forms of trans- Jor the companies and would permit them to exclude those chemicals 
portation available to you per week? and substances they consider to be trade secrets. Which of these views 
___% Walk __% Bicycle ___% Public transportation is closest to your own? 
—_% Motor vehicle 1. Require labels on all chemicals and substances that the govern- 
e. A survey of motorcycle dealers: ment states are potentially harmful. 
a , 7 2. (Don’t know) 
Should the company continue its generous cooperative advertising 3. Require labels on only those chemicals and substances that com- 
program? panies decide are potentially harmful. 
f. A government survey of gasoline retailers: 


Suppose the full-service pump selling price for regular gasoline is 
232.8 cents per gallon on the first day of the month. Suppose on 
the 10th of the month the price is raised to 234.9 cents per gal- 
lon, and on the 25th of the month it is reduced to 230.9 cents per 


2. The following question was asked of a sample of television viewers: 


We are going to ask you to classify the type of fan you consider 

yourself to be for different sports and sports programs. 

èe Diehard Fan: Watch games, follow up on scores and sports news 
multiple times a day 
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e Avid Fan: Watch games, follow up on scores and sports news 
once a day 

* Casual Fan: Watch games, follow up on scores and sports news 
occasionally 

* Championship Fan: Watch games, follow up on scores and sports 
news only during championships or playoffs 

¢ Non-Fan: Never watch games or follow up on scores 

e Anti-Fan: Dislike, oppose, or object to a certain sport 


Does this question do a good job of avoiding ambiguity? 


10. 


Ti 
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d. Fora bank located in a college town to investigate the 
potential for attracting college students as checking account 
customers. 

The Apple Assistance Center is a hotline to solve problems for 

users of Macintosh computers and other Apple products. Design 

a short (postcard-size) consumer satisfaction/service quality 

questionnaire for the Apple Assistance Center. 

'NET Visit the following Web site: http://www.history.org. What type 

of questions might be asked in a survey to evaluate the effective- 

ness of this Web site in terms of being informative and in terms of 


3. How might the wording of a question about income influence : : : 
R being an effective sales medium? 
respondents’ answers? : : : 
; , ; 12. A client tells a researcher that she wants a questionnaire that 
4. What is the difference between a leading question and a loaded : Se 
don? evaluates the importance of 30 product characteristics and rates 
uestion: : i 
aes . her brand and 10 competing brands on these characteristics. The 
5. Design one or more open-ended response questions to measure f ; : oes 
Š ; . researcher believes that this questionnaire will induce respondent 
reactions to a magazine ad for a Xerox photocopier. : P 
i fatigue because it will be far too long. Should the researcher do 
6. Evaluate the layout of the filter question that follows: : : : : 
exactly what the client says or risk losing the business by sug- 
Are you employed either full time or gesting a different approach? 
part time? 13. ETHICS Go to http://www.nrsc.org and look at one of the avail- 
Mark (x) one. able surveys. Usually, these involve a short questionnaire about 
If yes: How many hours per week are its political position. It also includes a “Support Reply Form,” a 
you usually employed? Mark (x) one. solicitation for donations. Is this approach ethical? 
Less than 35 35 or more 14. ‘NET Visit Mister Poll at http://www.misterpoll.com, where you 
What is the zip code at your usual place will find thousands of user-contributed polls on every imag- 
of work? inable topic from the controversial to the downright zany. 
eee What you find will depend on when you visit the site. How- 
ever, you might find something such as a movie poll, where 
7. Develop a checklist of things to consider in questionnaire you pick your favorite film of the season. Evaluate the ques- 
construction. tions in the poll. 
8. It has been said that surveys show that consumers hate advertis- 15. Try to find two friends that know the same foreign language. 
ing, but like specific ads. Comment. Write 10 Likert questions that measure how exciting a retail 
9. Design a complete questionnaire: store environment is to shop in. Have one of your friends 


a. To evaluate a new fast-food fried chicken restaurant. 

b. To measure consumer satisfaction with an airline. 

c. For your local Big Brothers and Big Sisters organization to 
investigate awareness of and willingness to volunteer time to 
this organization. 


Research Activity 


1: 


Design eight questions that assess how effective an undergradu- 
ate college business course has been. 


interpret the question into the foreign language. Have the 
other take the translation and state each question in English. 
How similar is the translated English to the original English? 
Comment. 


Case 15.1 Agency for Health Care Research and Quality 


At the U.S. Department of Health and Human 
Services, the Agency for Healthcare Research and 
Quality (AHRQ) developed a survey to measure 
hospital employees’ attitudes about patient safety 
in their facilities.” The survey is designed to help 
hospitals ensure safety by creating an environ- 


ees deliver care. The AHRQ suggests that hospitals use the survey 
to identify areas needing improvement and repeat its use to track 
changes over time. 

The survey is shown in Case Exhibit 15.1—1. 


~ 


i 


© GETTY IMAGES/ 
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Questions 
ment in which employees share information, improve safety when 1. Evaluate the questionnaire. Can you suggest any improvements? 


problems are identified, and if necessary, change the way employ- 2. Will this survey meet its objectives? Explain. 
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AHRQ Hospital Questionnaire 


HOSPITAL SURVEY ON PATIENT SAFETY CULTURE 


INSTRUCTIONS 


This survey asks for your opinions about patient safety issues, medical error, and event reporting in your hospital and 
will take about 10 to 15 minutes to complete. 


An “event” is defined as any type of error, mistake, incident, accident, or deviation, 
regardless of whether or not it results in patient harm. 


“Patient safety” is defined as the avoidance and prevention of patient injuries or 
adverse events resulting from the processes of health care delivery. 


SECTION A: Your Work Area/Unit 


In this survey, think of your “unit” as the work area, department, or clinical area of the hospital where you spend 
most of your work time or provide most of your clinical services. 


What is your primary work area or unit in this hospital? Mark ONE answer by filling in the circle. 
© a. Many different hospital units/No specific unit 


O b. Medicine (non-surgical) O g. Intensive care unit (any type) O |. Radiology 

O c. Surgery O h. Psychiatry/mental health O m. Anesthesiology 

O d. Obstetrics © i. Rehabilitation © n. Other, please specify: 
O e. Pediatrics © j. Pharmacy 

© f. Emergency department O k. Laboratory 


Please indicate your agreement or disagreement with the following statements about your work area/unit. 
Mark your answer by filling in the circle. 


Strongly Strongly 
Disagree Disagree Neither Agree Agree 
Think about your hospital work area/unit... v v v v v 
(ReopleisuppornoneianoinenminmitMisauni a 0) © (©) @ © 
2. We have enough staff to handle the workload............:::::cccceeseeeeeeeees D @ (©) (O) © 
3. When a lot of work needs to be done quickly, we work together as a 
teaMitOngetitheaw Orkid OE keane steerer E ee cers © © © ® © 
4. inthis unit, people treat each other with respect..-...--.-.-.--...--11--+1211211--1: ©) © © @ © 
5. Staff in this unit work longer hours than is best for patient care............ ©) © © @ (©) 
6. We are actively doing things to improve patient safety..............:.ccee O) © © (©) © 
7. We use more agency/temporary staff than is best for patient 
Cee A S R A TAN E E wee me © @ © © © 
8. Staff feel like their mistakes are held against them.... © © © (O) © 
9. Mistakes have led to positive changes Nene..........-2---.-.:.csccececccecereeeeeeesees © © (©) @ © 
10. Itis just by chance that more serious mistakes don’t happen 
O E E err eaeerece ee recera errr © © © © © 
11. When one area in this unit gets really busy, others help out................... © © © @ © 
12. When an event is reported, it feels like the person is being written up, 
OINEN ONONE aeee e E E eens EA sere ® ©) © (©) © 


(continued) 
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AHRQ Hospital Questionnaire (continued) 


SECTION A: Your Work Area/Unit (continued 


Strongly Strongly 
Disagree Disagree Neither Agree Agree 
Think about your hospital work area/unit... v v v v v 
13. After we make changes to improve patient safety, we evaluate their 
offectiveno ss n asa seen eet tierra T A A ern © @ © ® © 
14. We work in "crisis mode" trying to do too much, too quickly................---. © © © @ © 
15. Patient safety is never sacrificed to get more work done @) © (©) (©) © 
16. Staff worry that mistakes they make are kept in their personnel 
E a EEEE AA AE AEE EEE EEE A EE EAEE O A © @ © @® © 
17. We have patient safety problems in this mi essence ©) © (©) @ © 
18. Our procedures and systems are good at preventing errors from 
happeningi e ee eecracena os acre rececrierre ere rarcronarcree cere irre © @ © © © 


SECTION B: Your Supervisor/Manager 
Please indicate your agreement or disagreement with the following statements about your immediate supervisor/manager 
or person to whom you directly report. Mark your answer by filling in the circle. 


Strongly Strongly 
Disagree Disagree Neither Agree Agree 


1. My supervisor/manager says a good word when he/she sees a job 
done according to established patient safety procedures...............::000 
2. My supervisor/manager seriously considers staff suggestions for 
improving PATleMteSal ety teste m crease were carton orem SeenON 
3. Whenever pressure builds up, my supervisor/manager wants us to 
work faster, even if it means taking shortcuts ...........ccccccessteseseeecccseseeesees 
4. My supervisor/manager overlooks patient safety problems that happen 
ONARE O ONIS Eeee EEE EO E E EAA ETE corner rere rere cerca rece cee ere 


© OF © fOr 
O O O Qa“ 
© © © Qua 
© © © ®< 
© O OQ 


SECTION C: Communications 
How often do the following things happen in your work area/unit? Mark your answer by filling in the circle. 


Some- Most of 
Never Rarely times the time Always 


Think about your hospital work area/unit... v v v v v 
Be a paceman OI a 
“AEE A A oO OO OC 
3. We are informed about errors that happen in this unit..........-..--+...-+-..-- ©) © ©) @ © 
a å OC Ce 
tee a a ome a rae Oe o> 120 
i ete Oe Con A E ENE 


(continued) 
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AHRQ Hospital Questionnaire (continued) 


SECTION D: Frequency of Events Reported 
In your hospital work area/unit, when the following mistakes happen, how often are they reported? 
Mark your answer by filling in the circle. 
Some- Most of 
Never Rarely times the time Always 
y v v Yy 
1. When a mistake is made, but is caught and corrected before 
affecting the patient, how often is this reported? ...........ccccccceseseeeeeeees 


v 
O © ©) ©) © 
2. When a mistake is made, but has no potential to harm the patient, 
VON? OUT (SS Mre pona E, © © © ® © 
® © © ® © 


3. When a mistake is made that could harm the patient, but does not, 
MOA OES CEOE A eere ea E EE 


SECTION E: Patient Safety Grade 
Please give your work area/unit in this hospital an overall grade on patient safety. Mark ONE answer. 


© O O O © 
A B C D E 
Excellent Very Good Acceptable Poor Failing 


SECTION F: Your Hospital 

Please indicate your agreement or disagreement with the following statements about your hospital. 

Mark your answer by filling in the circle. 
Strongly Strongly 
Disagree Disagree Neither Agree Agree 


Think about your hospital... v v v v v 
1. Hospital management provides a work climate that promotes 

patot saa e E AE E E A E rire © @ © ® © 
2. Hospital units do not coordinate well with each other............+..++++1.++++.-:-- © © ©) ©) © 
3. Things “fall between the cracks” when transferring patients from one 

Unittoanoth or. naa Ae eee recent e E ee eared arse etree © 2) © ® © 
4. There is good cooperation among hospital units that need to work 

Oaea pe scece eee see EO te oarrer von eee aee eer © @ © ® © 
5. Important patient care information is often lost during shift 

changes weer a A E E e a serene © @ © ® © 
6. Itis often unpleasant to work with staff from other hospital units ............ O © ©) @ © 
7. Problems often occur in the exchange of information across hospital 

units e e artery ere choeterceiey cris © @ © ® © 
8. The actions of hospital management show that patient safety is a top 

prionn e E E ute T A E E E E © @ © ® ©) 
9. Hospital management seems interested in patient safety only 

aiteranadVverselevemt Map PM Seesees cere eerste reer ee © © ©) ® © 
10. Hospital units work well together to provide the best care for 

patients? oa m E PEE EEA E E A A E E E E T e ET © @ © i) © 
11. Shift changes are problematic for patients in this hospital..........00.....00... © © (©) @ © 


SECTION G: Number of Events Reported 
In the past 12 months, how many event reports have you filled out and submitted? Mark ONE answer. 


© a. No event reports © d. 6 to 10 event reports 
© b. 1 to 2 event reports O e. 11 to 20 event reports 
O c. 3to5 event reports © f. 21 event reports or more 


(continued) 
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AHRQ Hospital Questionnaire (continued) 


SECTION H: Background Information 
This information will help in the analysis of the survey results. Mark ONE answer by filling in the circle. 


1. How long have you worked in this hospital? 


© a. Less than 1 year © d. 11 to 15 years 
O b. 1 to 5 years O e. 16 to 20 years 
O c. 6 to 10 years © f. 21 years or more 
2. How long have you worked in your current hospital work area/unit? 
© a. Less than 1 year © d. 11 to 15 years 
O b. 1 to 5 years O e. 16 to 20 years 
O c. 6 to 10 years © f. 21 years or more 
3. Typically, how many hours per week do you work in this hospital? 
© a. Less than 20 hours per week O d. 60 to 79 hours per week 
O b. 20 to 39 hours per week O e. 80 to 99 hours per week 
O c. 40 to 59 hours per week © f. 100 hours per week or more 
4. What is your staff position in this hospital? Mark ONE answer that best describes your staff position. 
© a. Registered Nurse O h. Dietician 
O b. Physician Assistant/Nurse Practitioner © i. Unit Assistant/Clerk/Secretary 
O c. LVN/LPN O j. Respiratory Therapist 
© d. Patient Care Assistant/Hospital Aide/Care Partner O k. Physical, Occupational, or Speech Therapist 
© e. Attending/Staff Physician © I. Technician (e.g., EKG, Lab, Radiology) 
O f. Resident Physician/Physician in Training © m. Administration/Management 
© g. Pharmacist © n. Other, please specify: 


5. In your staff position, do you typically have direct interaction or contact with patients? 
O a. YES, | typically have direct interaction or contact with patients. 
O b. NO, | typically do NOT have direct interaction or contact with patients. 


6. How long have you worked in your current specialty or profession? 


O a. Less than 1 year O d. 11 to 15 years 
O b. 1 to 5 years O e. 16 to 20 years 
Oc. 6to 10 years © f. 21 years or more 


SECTION I: Your Comments 
Please feel free to write any comments about patient safety, error, or event reporting in your hospital. 


THANK YOU FOR COMPLETING THIS SURVEY. 


Source: Agency for Healthcare Research and Quality, “Hospital Survey on Patient Safety Culture,” http://www.ahrq.gov/qual/hospculture/. 
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Case 15.2 Canterbury Travels 


Hometown, located in the north central United 


States, had a population of about fifty thousand. 


The questionnaire that Roxanne Freeman designed is shown in 
Case Exhibit 15.2—1. 


expected to have more business than she actually had. She decided 
that she needed to conduct a survey to determine how much busi- 
ness Hometown offered. She also wanted to learn whether people 
were aware of Canterbury Travels. She thought that this survey 
would determine the effectiveness of her advertising. 


Travel Questionnaire 


ae There were two travel agencies in Hometown 

2 before Canterbury Travels opened its doors. Questions 

ES | Canterbury Travels was in its second month 1. Critically evaluate the questionnaire. 

oe l of operations. Owner Roxanne Freeman had Will Canterbury Travels gain the information it needs from this 


survey? 
Design a questionnaire to satisfy Roxanne Freeman’s informa- 
tion needs. 


The following questionnaire pertains to a project being conducted by a local travel agency. The intent of the study is to better understand 
the needs and attitudes of Hometown residents toward travel agencies. The questionnaire will take only 10 to 15 minutes to fill out at your 


convenience. Your name will in no way be connected with the questionnaire. 


1. Have you traveled out of state? 
2. If yes, do you travel for: 
Business Both 
Pleasure 
3. How often do you travel for the above? 
0-1 times per month 0-1 times per year 
2-3 times per month 2-3 times per year 
4-5 times per month 4-5 times per year 
6 or more times per month 6 or more times per year 
4. How do you make your travel arrangements? 
Airline Travel agency 
Other (please specify) 


Yes No 


5. Did you know that travel agencies do not charge the customer for their services? 


Yes No 


6. Please rate the following qualities that would be most important to you in the selection of a travel agency: 


Free services 
(reservations, advice, and delivery of tickets 
and literature) 

Convenient location 

Knowledgeable personnel 

Friendly personnel 

Casual atmosphere 

Revolving charge account 

Reputation 

Personal sales calls 

7. Are you satisfied with your present travel agency? 


Holiday Travel 
Leisure Tours 
Canterbury Travels 
Other 
8. If not, what are you dissatisfied with about your travel agency? 


Free services 
(reservations, advice, and delivery of tickets 
and literature) 

Convenient location 

Knowledgeable personnel 

Friendly personnel 

Casual atmosphere 

Revolving charge account 

Reputation 

Personal sales calls 


Good Bad 


Very satisfied 


Very dissatisfied 


Good Bad 


(continued) 
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Travel Questionnaire (continued) 


9. Did you know that there is a new travel agency in Hometown? 


Yes No 
10. Can you list the travel agencies in Hometown and their locations? 
11. Do you use the same travel agency repeatedly? 
ix L L vs L L p ox 
(J) U wu =S U W (J) => wu 
aeo hrs Qe/ 9Q-/ a Q a oa 
Ge), =|, Ge) EE_E g a3 JEg 
TESTE STES Ceo Es pe NIE SOES 
©) #5) SIAS (Sse a A o Sea NNS SoS Sole 3 SS 


Holiday Travel 
Leisure Tours 
Canterbury Travels 
Other (please specify) 


12. Have you visited the new travel agency in Hometown? 


Yes No 


13. If yes, what is its name? 
14. How do you pay for your travel expenses? 


Cash Company charge 
Check Personal charge 
Other 


Credit card 
15. Which of these have you seen advertising for? 


Holiday Travel 
Canterbury Travels 
Other 
16. Where have you seen or heard the advertisement you describe above? 
17. Would you consider changing travel agencies? 
No 
The following are some personal questions about you that will be used for statistical purposes only. Your answers will be held in the strictest 


Yes 


confidence. 
18. What is your age? 
19-25 46-55 
26-35 56-65 
36-45 Over 65 
19. What is your sex? 
Male Female 
20. What is your marital status? 
Single Divorced 
Married Widowed 
21. How long have you lived in Hometown? 
0-6 months 5-10 years 
7-12 months 11-15 years 
Over 15 years 


1-4 years 
22. What is your present occupation? 
Laborer 


Business and professional 
Salaried and semiprofessional Student 
Skilled worker 
23. What is the highest level of education you have completed? 
Elementary school 1-2 years of college 
Junior high school 3-4 years of college 
Senior high school More than 4 years of college 
Trade or vocational school 
24. What is your yearly household income? 
$0-$5,000 $25,001-$40,000 
$5,001-$10,000 $40,001-$60,000 
$10,001-$15,000 $60,000 and above 
$15,001-$25,000 
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Case 15.3 McDonald’s Spanish Language Questionnaire 


4 The questions in Case Exhibit 15.3-1, about 
a visit to McDonald’s, originally appeared in 
Spanish and were translated into English. 


' Questions 
© 1. What is the typical process for developing 


© GETTY IMAGES/ 
PHOTODISC GREEN 


questionnaires for markets where consumers 
speak a language other than English? 


McDonald's Questionnaire 


2. Find someone who speaks Spanish and have him or her back 


translate the questions that appear in Case Exhibit 15.3—1. Are 
these Spanish-language questions adequate? 


Muy 
SATISFECHO/A 


G) 2) (3) (4) (5) 


SATISFECHO/A 


AQUI == 1. En general, ¿qué tan satisfecho/a quedo Rs 
SE EMPIEZA con su visita a este McDonald's hoy? 
2. Su visita fue....... 
3. Su visita fue....... Durante el Desayuno (D), 
Almuerzo (A), Cena (C) 
4. Su visita fue....... Entre semana (E) 
o Fin de semana (F) 
COMIDA 5. ¿Quedó satisfecho/a con la comida que recibio hoy? 


Si NO, ¿cuál fue el problema? Sandwich / platillo frío Z 
Apariencia desagradable 


Mal sabor de la comida 

Pocas papas en la bolsa / caja 
Papas / tortitas de papa frías 
Papas no bien saladas 

Bebida aguada / de mal sabor 


Favor de rellenar el(los) círculo(s) 
apropiado(s). 


Adentro (A) o en el Drive-thru (DT) Adentro 


(07) Drive-thru 


(©) Desayuno A) Almuerzo Cena 


(F) Fin de semana 


(N) No — 


Entre semana 


© si 


UUOU00U 


Case 15.4 Schönbrunn Palace in Vienna 


4 The Schönbrunn Palace in Vienna was con- 
| structed in the eighteenth century during the 


ae reign of the Hapsburgs. Today this former sum- 
os f : : ANE 
$y mer residence of the imperial family is one of 
ES } Austria’s top tourist attractions. 

ie) . . E 
oz a The questions in Case Exhibit 15.4-1, about 


a visit to the Schönbrunn Palace, originally appeared in German and 
were translated into English. 


Questions 


1: 


What is the typical process for developing questionnaires for 
markets where consumers speak a different language? 

Find someone who speaks German and have him or her back 
translate the questions that appear in Case Exhibit 15.4-1. Are 
these German questions adequate? 
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CASE EXHIBIT 15.4-1 Schönbrunn Palace Questionnaire 


Befragung der Besucher SchloßB Schönbrunn 
Land/Staat Bundesland (nur für Ö) 

Alter Jahre Geschlecht a männlich a weiblich 
Heutiges Datum P . 199, Uhrzeit 


+ Waren Sie heute zum ersten Mal im Schloß Schönbrunn? 
o ja a nein, zum __. Mal 


* Welche Tour haben Sie gemacht? 
o Grand Tour (40 Räume) 
o Imperial Tour (22 Raume) 


+ Welche Art von Führung haben Sie gewählt? 


a Schönbrunn Führung (Angebot des Schlosses) 

a eigener Reiseführer (Reisegruppe, Fremdenführer) 

O Tonbandfiihrer (Audioguide) in Sprache 
o keinerlei Führung =— = = = 


* Falls Sie an einer Führung teilgenommen haben: 
Wie finden Sie Ihren Führer bzw. Ihre Fiihrerin? 
© sehr freundlich A eher freundlich O eher unfreundlich O sehr unfreundlich 
weil ... 


* Bei Verwendung eines Tonbandfiihrers (Audioguide): 
Wie finden Sie die angebotenen Audioguides? 
a sehr gut a eher gut 0 eher schlecht a sehr schlecht 
weil ... 


+ Wie ist Ihr Gesamteindruck vom Schloß Schönbrunn alles in allem? 
sehr gut A eher gut o eher schlecht a sehr schlecht 
weil ... 


+ Wie ist Ihr Eindruck vom Personal im Schloß? 
© sehr gut 0 eher gut © eher schlecht sehr schlecht 
weil... 


+ Wie gut finden Sie sich im Schloß Schénbrunn/Park zurecht (Hinweisschilder, 
kennt man sich gut aus, findet man die Kassen, Toiletten, den Ausgang, etc.)? 
sehr gut a eher gut a eher schlecht a sehr schlecht 
weil ... 
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¢ Fühlten Sie sich nach dem Besuch gut informiert über das Schloß und 
selne Geschichte? 
G sehr gut a eher gut 2 eher schlecht © sehr schlecht 


+ Wurden Sie bei der Besichtigung gestört? 
durch (andere) Gruppen: 


a sehr stark £ etwas a kaum a gar nicht 
durch Einzelbesucher: 
o sehr stark 2 etwas a kaum a gar nicht 


* Wie finden Sie die Art, wie die Räume dargestellt werden (Einrichtung, 
Möblierung, Beleuchtung, Dekoration, etc.)? 

a sehr gut a eher gut a eher schlecht a sehr schlecht 

weil ... 


+ Haben Sie nach dem Besuch im Schloß Schönbrunn eine lebendige 
Vorstellung vom einstigen Leben bei Hof? 
a ja a etwas 2 kaum a nein 
weil ... 


+ Was würden Sie noch gerne über das Schloß erfahren? 


» Wie finden Sie die Eintrittspreise? 
viel zu teuer ^ etwas zu teuer a angemessen A günstig 


¢ Wie finden Sie das Angebot im Museumshop? 
a sehr gut A eher gut a eher schlecht o sehr schlecht 
weil ... 


+ Was könnte Ihrer Meinung nach nach verbessert werden? 


Vielen Dank für Ihren Besuch und Ihre Anregungen! 


APPENDIX 15A 
QUESTION 
WORDING AND 
MEASUREMENT 
SCALES FOR 
COMMONLY 
RESEARCHED 
TOPICS 


As Chapters 13, 14, and 15 explain, problem definitions and research objectives determine the 
nature of the questions to be asked. In most cases researchers construct custom questions for their 
specific projects. However, in many instances different research projects have some common 
research objectives. This appendix compiles question wordings and measurement scales frequently 
used by business researchers. It is by no means exhaustive. It does not repeat every question already 
discussed in the text. For example, it does not include the hundreds of possible semantic differen- 
tial items or Likert scale items discussed in Chapter 14. 

The purpose of this appendix is to provide a bank of questions and scales for easy reference. 
It can be used when business research objectives dictate investigation of commonly researched issues. 


Questions about Advertising 


Awareness 


Have you ever seen any advertising for (brand name)? 


Yes O No 


Are you aware of (brand name)? 


Yes O No 


Tf yes, how did you first become aware of (brand name)? 


e In-flight airline magazine 

e Poster or billboard at airport 
° Television at airport 

e = Card in the seatback pocket 
e Other (please specify) 


Unaided Recall/Top of the Mind Recall 


Can you tell me the names of any brands of (product category) for which you have seen or heard any advertising 
recently? 
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(After reading a magazine or viewing a TV program with commercials) Please try to recall all the brands you 
saw advertised on/in (name of program or magazine). (DO NOT PROBE.WRITE BRAND NAMES 
IN ORDER MENTIONED BY RESPONDENT.) 


(After establishing that the respondent watched a certain television program) Do you recall seeing a commercial 


for any (product category)? (IF YES) What brand of (product category) was advertised? 


Aided Recall 


(After establishing that the respondent watched a certain television program or read a certain magazine) Now, 
I’m going to read you a list of brands. Some of them were advertised on/in (name of program or magazine); 
others were not. Please tell me which ones you remember seeing, even if you mentioned them before. 


Brand A (Advertised) 
Brand B (Not advertised) 
Brand C (Advertised) 


Do you remember seeing a commercial for (specific brand name)? 


Yes O No 


Recognition 


(Show advertisement to respondent) Did you see or read any part of this advertisement? 


Yes O No 


Message Communication/Playback (Sales Point Playback) 


These questions require that the researcher first qualify awareness with a question such as “Have you 
ever seen any advertising for (brand name)?” The interviewer then asks message playback questions. 


(If yes) What did the advertising tell you about (brand name or product category)? 


Other than trying to sell you the product, what do you think was the main idea in the description you just 
read (commercial you just saw)? 


What was the main thing it was trying to communicate about the product? 
What did the advertising for (brand name) say about the product? 


What did you learn about (brand name) from this advertisement? 


Attitude Toward the Advertisement 


Please choose the statement below that best describes your feelings about the commercial you just saw. 


I liked it very much. 

I liked it. 

I neither liked nor disliked it. 
I disliked it. 

I disliked it very much. 
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Was there anything in the commercial you just saw that you found hard to believe? 
LI Yes O No 


What thoughts or feelings went through your mind as you watched the advertisement? 


Attitude Toward Advertised Brand (Persuasion) 


Based on what you’ve seen in this commercial, how interested would you be in trying the product? 


Extremely interested 


Very interested 


Somewhat interested 


Not very interested 
Not at all interested 


The advertisement tried to increase your interest in (brand). How was your buying interest affected? 


Increased considerably 


Increased somewhat 
Not affected 
Decreased somewhat 


Decreased considerably 


Based on what you’ve just seen in this commercial, how do you think (brand name) might compare to other 
brands you’ve seen or heard about? 


Better 
As good as 


Not as good as 


Readership/Viewership 


Have you ever read (seen) a copy of (advertising medium)? 


Yes O No 


How frequently do you (watch the evening news on channel X)? 


Every day 


5—6 times a week 


2—4 times a week 


Once a week 


Less than once a week 


Never 


Several of the questions about products or brands in the following section are also used to assess 
attitudes toward advertised brands. 


Questions about Ownership 
and Product Usage 


Ownership 


Do you own a (product category)? 


LI Yes LI No 
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Purchase Behavior 


Have you ever purchased a (product category or brand name)? 


O Yes O No 


Regular Usage 


Which brands of (product category) do you regularly use? 


Brand A 
Brand B 
Brand C 
Do not use 


Which brands of (product category) have you used in the past month? 


Brand A 
Brand B 
Brand C 
Do not use 


In an average month, how often do you buy (product category or brand name)? 
Record Number of Times per Month 


How frequently do you buy (product category or brand name)? 


Every day 
5—6 times a week 


2—4 times a week 


Once a week 


Less than once a week 
Never 


Would you say you purchase (product category or brand name) more often than you did a year ago, about the 
same as a year ago, or less than a year ago? 


More often than a year ago 


About the same as a year ago 


Less than a year ago 


Questions about Goods and Services 


Ease of Use 


How easy do you find using (brand name)? 


Very easy 
O Easy 
© Neither easy nor difficult 
O Difficult 
O Very difficult 


Uniqueness 


How different is this brand from other brands of (product category)? 


Very different 
Somewhat different 
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O Slightly different 
O Not at all different 


How would you rate this product (brand name) on uniqueness? 


LI Extremely unique 
LI] Very unique 
LI Somewhat unique 


LI Slightly unique 


O Not at all unique 


Please form several piles of cards so that statements that are similar to each other or say similar things are in 
the same pile. You may form as many piles as you like, and you may put as many or as few cards as you want 
in a pile. You can set aside any statements that you feel are unique or different and are not similar to any of 
the other statements. 


Attribute Ratings/Importance of Characteristics 


Measurement scales such as the semantic differential and Likert scales are frequently used to assess 
product attributes, especially when measuring brand image or store image. See Chapter 15. 


How important is (specific attribute), as far as you are concerned? 


Very important 

Of some importance 

Of little importance 

Of absolutely no importance 


We would like you to rate (brand name or product category) on several different characteristics. (For concept 
tests, add: Since you may not have used this product before, please base your answers on your impressions from 
what you’ve just read.) 


Characteristic A 


Excellent 
Good 
Fair 
Poor 


Interest 


In general, how interested are you in trying a new brand of (product category)? 


Very interested 


Somewhat interested 


Not too interested 
Not at all interested 


Like/Dislike 


What do you like about (brand name)? 


What do you dislike about (brand name)? 
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How do you like the taste of (brand name)? 


Like it very much 

Like it 

Neither like nor dislike it 
Dislike it 

Strongly dislike it 


Preference 


Which credit card do you prefer to use? 


American Express 
MasterCard 

Visa 

No preference 


Expectations 


How would you compare the way (company’s) service was actually delivered with the way you had anticipated 
that (company) would provide the service? 


Much better than expected 


Somewhat better than expected 


About the same as expected 


Somewhat worse than expected 


Much worse than expected 


Satisfaction 


How satisfied were you with (brand name)? 


Very satisfied 
Somewhat satisfied 
Very dissatisfied 


How satisfied were you with (brand name)? 


Very satisfied 
Very dissatisfied 
Somewhere in between 


(If somewhere in between) On balance, would you describe yourself as leaning toward being more satisfied or 
more dissatisfied with (brand name) than with the brand you normally use? 


Satisfied 
Dissatisfied 


Now that you have owned (brand name) for 6 months, please tell us how satisfied you are with it. 


Completely satisfied 
Very satisfied 

Fairly well satisfied 
Somewhat dissatisfied 
Very dissatisfied 


Quality 


How would you rate the quality of (brand name)? 


Excellent 
Good 
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LI Fair 
LJ Poor 


Please indicate how the quality of (Brand A) compares with the quality of (Brand B). 


LJ Better 
O About the same 
LI] Worse 


Problems 


Have you experienced problems with (company’s) service? 


Yes No 


When attempting to contact (company’s) representative, how much of a problem, if any, was each of the 
following: 


Phones busy 


No problem at all Slight problem O Somewhat of a problem Major problem 


Put on hold too long or too often 


No problem at all Slight problem O Somewhat of a problem Major problem 


What are the major shortcomings of (brand name)? (PROBE: What other shortcomings are there?) 


Benefits 


Do you think (product concept) would have major benefits, minor benefits, or no benefits at all? 


Major benefits 
Minor benefits 
No benefits at all 


Improvements 


In what ways, if any, could (brand name) be changed or improved? We would like you to tell us anything you 
can think of, no matter how minor it seems. 


Buying Intentions for Existing Products 


Do you intend to buy a (brand name or product category) in the next month (3 months, year, etc.)? 


Yes No 


If a free (product category) were offered to you, which would you select? 


Brand A 
Brand B 
Brand C 
Do not use 


Buying Intentions Based on Product Concept 


(Respondent is shown a prototype or asked to read a concept statement.) Now that you have read about (prod- 
uct concept), if this product were available at your local store, how likely would you be to buy it? 


Would definitely buy it 
Would probably buy it 
Might or might not buy it 
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O Would probably not buy it 
LI Would definitely not buy it 


(Hand response card to respondent.) Which phrase on this card indicates how likely you would be to buy this 
product the next time you go shopping for a product of this type? 


LI Would definitely buy it 
LI Would probably buy it 
LI) Might or might not buy it 
O Would probably not buy it 
O Would definitely not buy it 


Now that you have read about (product concept), if this product were available at your local store for (price), 
how likely would you be to buy it? 


O Would definitely buy it 
O Would probably buy it 
LI) Might or might not buy it 


LI Would probably not buy it 
O Would definitely not buy it 


How often, if ever, would you buy (product concept)? 


LI Once a week or more 


O Once every 2 to 3 weeks 


O Once a month/every 4 weeks 


O One every 2 to 3 months 


O Once every 4 to 6 months 


O Less than once a year 


LI] Never 


Based on your experience, would you recommend (company) to a friend who wanted to purchase (product 
concept)? 


LI Recommend that the friend buy from (company) 


LI Recommend that the friend not buy from (company) 
LI Offer no opinion either way 


Reason for Buying Intention 


Why do you say that you would (would not) buy (brand name)? (PROBE: What other reason do you have 


for feeling this way?) 


Questions about Demographics 


Age 
What is your age, please? 


What year were you born? 


Education 


What is your level of education? 


Some high school or less 


Completed high school 
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LI Some college 


LI Completed college 


LI Some graduate school 


LI Completed graduate school 


What is the highest level of education you have obtained? 


LI Some high school or less 


LI High school graduate 


LI Some college 


LI College graduate 


LI Postgraduate school 


LI Completed graduate school 


Marital Status 


What is your marital status?’ 


Married 

Divorced /separated 
Widowed 

Never married /single 


Children 


Are there any children under the age of 6 living in your household? 


Yes No 


If yes, how many? 


Income 


Which group describes your annual family income? 


Under $20,000 

$20, 000-$39,999 
$40, 000-$59, 999 
$60, 000-$79, 999 
$50,000-$99, 999 
$100, 000-$149,999 
$150,000 or more 


Please check the box that describes your total household income before taxes in (year). Include income for your- 
self as well as for all other persons who live in your household. 


Less than $10,000 LI $35,000-$39,999 
$10,000-$14,999 CI $40,000-$49,999 
$15,000-$19, 999 C $50,000-$59,999 
$20, 000-$24, 999 CI = $60,000-$74,999 
$25,000-$29,999 CI $75,000 or more 
$30, 000-$34,999 
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Occupation 


What is your occupation? 


Professional 
Executive 
Managerial 
Administrative 
Sales 


What is your occupation? 


Homemaker 
Professional/technical 

Upper management / executive 
Middle management 

Sales /marketing 


OOOdO0 


m0000 


Technical 
Labor 
Secretarial 
Clerical 
Other 


Clerical or service worker 
Tradesperson /machine operator 
Laborer 

Retired 

Student 


CHAPTER 16 
SAMPLING DESIGNS 
AND SAMPLING 
PROCEDURES 


After studying this chapter, you should be able to 


ils 


Explain reasons for taking a sample rather than a 
complete census 

Describe the process of identifying a target population 
and selecting a sampling frame 

Compare random sampling and systematic (nonsampling) 
errors 

Identify the types of nonprobability sampling, including 
their advantages and disadvantages 


. Summarize the advantages and disadvantages of the 


various types of probability samples 


. Discuss how to choose an appropriate sample design, as 


well as challenges for Internet sampling 


Chapter Vignette: Changing Pocketbook Problems for 


Today’s Families 


It is easy to ask people what they consider to be the most pressing financial problems they face. 
From low wages, to rising health care and housing costs, to a concern for too much debt, these 
problems are constantly on the minds of many families today. When pressed about which finan- 
cial problem is most important, some interesting trends occur. These trends could not have been 
captured if not for the work of large-scale sampling of populations. 

Each quarter, the Gallup Corporation develops a representative sample of approximately 
1,000 U.S. adults, aged 18 and older, to capture public perceptions on a variety of relevant 
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topics, to include financial concerns of the family. Since the sample is developed and 


obtained carefully, it serves as a representation of the popula- 
tion of adults in the U.S. who are 18 years or older. As 

a result of this sampling technique, researchers can be 

95 percent confident that the responses of the sample are 
reflective of this national population, with a sampling error 
of less than 3 percent. Using telephone based interviews, 
the Gallup Corporation asks the respondent to describe “the 
most important financial problem facing your family today.” 
Responses are open-ended, and are then coded based upon 
the theme of the response. 

Interestingly, trends suggest that the most important 
financial problem facing families can often change over time, 
and may be reflective of the respondent's current awareness of 
the financial challenges of the day. For example, when energy 
and gas prices were at their highest during the summer of 2008, 
almost one-third (29 percent) of the July 2008 Gallup respon- 


dents listed energy and gas prices as their most important problem. However, in less than six 
months (January 2009), energy and gas prices were mentioned by only 3 percent. While health 
care costs was mentioned by 19 percent of families in October 2007, only 9 mentioned health 


care a year later. 


The implication of these types of changing trends suggest that financial problems facing fam- 
ilies evolve over time. And, families often look no further than their own pocketbook (or credit 
card statement) when they consider their greatest financial challenges. The use of large-scale 
representative samples by the Gallup Corporation helped reveal these interesting trends.' 
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Introduction 


Sampling is a familiar part of daily life. A customer in a bookstore picks up a book, looks at 
the cover, and skims a few pages to get a sense of the writing style and content before deciding 
whether to buy. A high school student visits a college classroom to listen to a professor’s lecture. 
Selecting a university on the basis of one classroom visit may not be scientific sampling, but in 
a personal situation, it may be a practical sampling experience. When measuring every item in a 
population is impossible, inconvenient, or too expensive, we intuitively take a sample. 

Although sampling is commonplace in daily activities, these familiar samples are seldom sci- 
entific. For researchers, the process of sampling can be quite complex. Sampling is a central aspect 
of business research, requiring in-depth examination. This chapter explains the nature of sampling 
and ways to determine the appropriate sample design. 


Sampling Terminology 


As seen in the chapter vignette above, the process of sampling involves using a portion of a 
population to make conclusions about the whole population. A sample is a subset, or some part, 
of a larger population. The purpose of sampling is to estimate an unknown characteristic of a 
population. 

Sampling is defined in terms of the population being studied. A population (universe) is any 
complete group—for example, of people, sales territories, stores, or college students—that shares 
some common set of characteristics. The term population element refers to an individual member 
of the population. 

Researchers could study every element of a population to draw some conclusion. A census is 
an investigation of all the individual elements that make up the population—a total enumeration 
rather than a sample. Thus, if we wished to know whether more adult Texans drive pickup trucks 
than sedans, we could contact every adult Texan and find out whether or not they drive a pickup 
truck or a sedan. We would then know the answer to this question definitively. 


Why Sample? 


At a wine tasting, guests sample wine by having a small taste from each of a number of different 
wines. From this, the taster decides if he or she likes a particular wine and if it is judged to be of 
low or high quality. Ifan entire bottle were consumed to decide, the taster may end up not caring 
care about the next bottle. However, in a scientific study in which the objective is to determine 
an unknown population value, why should a sample rather than a complete census be taken? 


Pragmatic Reasons 


Applied business research projects usually have budget and time constraints. If Ford Motor Cor- 
poration wished to take a census of past purchasers’ reactions to the company’s recalls of defec- 
tive models, the researchers would have to contact millions of automobile buyers. Some of them 
would be inaccessible (for example, out of the country), and it would be impossible to contact all 
these people within a short time period. 

A researcher who wants to investigate a population with an extremely small number of popu- 
lation elements may elect to conduct a census rather than a sample because the cost, labor, and time 
drawbacks would be relatively insignificant. For a company that wants to assess salespersons’ satis- 
faction with its computer networking system, circulating a questionnaire to all 25 of its employees 
is practical. In most situations, however, many practical reasons favor sampling. Sampling cuts 
costs, reduces labor requirements, and gathers vital information quickly. These advantages may be 
sufficient in themselves for using a sample rather than a census, but there are other reasons. 
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sample 


A subset, or some part, of a larger 
population. 


population (universe) 


Any complete group of entities 
that share some common set of 
characteristics. 


population element 


An individual member of a 
population. 


census 


An investigation of all the 
individual elements that make up 
a population. 


COURTESY OF QUALTRICS.COM 


The data gathered in conjunction with the 
BRM Survey asks students questions related 
to job preferences. These data may well be 
of interest to prospective employers looking 
to hire qualified business people. 


1. How well do you think the results collected in this sur- 
vey represent the population of entry-level, business- 
oriented, recent college graduates? 

2. If question one shown in the screenshot does not 
describe the population to which this survey pertains, 
describe one that you believe is better represented by this 
data. In other words, work backwards from the data char- 
acteristics to infer a population that is well represented. 

3. Can the data be stratified in a way that would allow it to 
represent more specific populations? Explain your answer. 

4. Take a careful look at the choices indicated in the 
responses shown. Does this particular respondent neatly 
represent a common population? Comment. 


J 
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Accurate and Reliable Results 


As seen in the Research Snapshot on p. 390, another major reason for sampling is that most prop- 
erly selected samples give results that are reasonably accurate. If the elements of a population are 
quite similar, only a small sample is necessary to accurately portray the characteristic of interest. 
Thus, a population consisting of 10,000 eleventh grade students in all-boys Catholic high schools 
will require a smaller sample than a broader population consisting of 10,000 high school students 
from coeducational secondary schools. 

A visual example of how different-sized samples produce generalizable conclusions is provided 
in Exhibit 16.1. All are JPEG images that contain different numbers of “dots.” More dots mean 
more memory is required to store the photo. In this case, the dots can be thought of as sampling 
units representing the population which can be thought of as all the little pieces of detail that form 
the actual image. 

The first photograph is comprised of thousands of dots resulting in a very detailed photograph. 
Very little detail is lost and the face can be confidently recognized. The other photographs provide 
less detail. Photograph 2 consists of approximately 2,000 dots. The face is still very recognizable, 
but less detail is retained than in the first photograph. Photograph 3 is made up of 1,000 dots, 
constituting a sample that is only half as large as that in photograph 2. The 1,000-dot sample pro- 
vides an image that can still be recognized. Photograph 4 consists of only 250 dots. Yet, if you 
look at the picture at a distance, you can still recognize the face. The 250-dot sample is still use- 
ful, although some detail is lost and under some circumstances (such as looking at it from a short 
distance) we have less confidence in judging the image using this sample. Precision has suffered, 
but accuracy has not. 

A sample may on occasion be more accurate than a census. Interviewer mistakes, tabulation 
errors, and other nonsampling errors may increase during a census because of the increased volume 
of work. In a sample, increased accuracy may sometimes be possible because the fieldwork and tabu- 
lation of data can be more closely supervised. In a field survey, a small, well-trained, closely super- 
vised group may do a more careful and accurate job of collecting information than a large group of 
nonprofessional interviewers who try to contact everyone. An interesting case in point is the use of 
samples by the Bureau of the Census to check the accuracy of the U.S. Census. If the sample indicates 
a possible source of error, the census is redone. 
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ý M A } sg : 26" +4, 
Photograph 1 Photograph 2 
Portrait of young man 2,000 dots 


Photograph 3 
1,000 dots 250 dots 


Source: Adapted with permission from A. D. Fletcher and T. A. Bowers, Fundamentals of Advertising Research 
(Columbus, OH: Grid Publishing, 1983), pp. 60-61. 


Destruction of Test Units 


Many research projects, especially those in quality-control testing, require the destruction of 
the items being tested. If a manufacturer of firecrackers wished to find out whether each unit 
met a specific production standard, no product would be left after the testing. This is the exact 
situation in many research strategy experiments. For example, if an experimental sales presenta- 
tion were presented to every potential customer, no prospects would remain to be contacted 
after the experiment. In other words, if there is a finite population and everyone in the popula- 
tion participates in the research and cannot be replaced, no population elements remain to be 
selected as sampling units. The test units have been destroyed or ruined for the purpose of the 
research project. 
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IBIT 6.1 
A Photographic Example of 
How Sampling Works 
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Finding Out about Work Is a Lot of Work! 
What do people do for work? How long does it take them to get of eight months, and then are sampled 
there? What do they earn? These and many other questions are again for four more months before they 


surveyed for four months out of the sample 


critically important for United are removed from the panel. Moreover, 


States economists and social the sample is surveyed for each month on a 

scientists. The U.S. Census week that contains the 19th of that month. Not 

Bureau and the Bureau of surprisingly, the cost of conducting the CPS is measured in the 

Labor Statistics have jointly millions of dollars. 

asked these questions, every The sophistication and detail of the CPS is required to ensure 

month, for almost 70 years. that accurate national statistics are captured on a monthly basis. 
The work of these two As a result, the CPS is considered one of the standards by which 

Bureaus is captured by the other household surveys are conducted. The cost of the CPS, as 

Current Population Survey well as the need for extensive telephone and field staff, really 

(CPS). The CPS uses a scien- does represent a lot of “work”! 


tifically derived panel sample Source: U.S. Department of Labor, Bureau of Labor Statistics, and U.S Department of 
of 60,000 households. The Commerce, U.S. Census Bureau, Current Population Survey: Design and Methodology, 


participating households are Technical Paper 63RV (2002). 


Practical Sampling Concepts 


Before taking a sample, researchers must make several decisions. Exhibit 16.2 presents these deci- 
sions as a series of sequential stages, but the order of the decisions does not always follow this 
sequence. These decisions are highly interrelated. The issues associated with each of these stages, 
except for fieldwork, are discussed in this chapter and Chapter 17. Fieldwork is examined in 
Chapter 18. 


Defining the Target Population 


Once the decision to sample has been made, the first question concerns identifying the target pop- 
ulation. What is the relevant population? In many cases this question is easy to answer. Registered 
voters may be clearly identifiable. Likewise, if a company’s 106-person sales force is the population 
of concern, there are few definitional problems. In other cases the decision may be difficult. One 
survey concerning organizational buyer behavior incorrectly defined the population as purchasing 
agents whom sales representatives regularly contacted. After the survey, investigators discovered 
that industrial engineers within the customer companies rarely talked with the salespeople but 
substantially affected buying decisions. For consumer-related research, the appropriate population 
element frequently is the household rather than an individual member of the household. This 
presents some problems if household lists are not available. 

At the outset of the sampling process, the target population must be carefully defined so that 
the proper sources from which the data are to be collected can be identified. The usual technique 
for defining the target population is to answer questions about the crucial characteristics of the 
population. Does the term comic book reader include children under six years of age who do not 
actually read the words? Does all persons west of the Mississippi include people in east bank towns 
that border the river, such as East St. Louis, Illinois? The question to answer is, “Whom do we 
want to talk to?” The answer may be users, nonusers, recent adopters, or brand switchers. 

To implement the sample in the field, tangible characteristics should be used to define the 
population. A baby food manufacturer might define the population as all women still capable of 
bearing children. However, a more specific operational definition would be women between the 
ages of 12 and 50. While this definition by age may exclude a few women who are capable of 
childbearing and include some who are not, it is still more explicit and provides a manageable basis 
for the sample design. 
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4A How Much Does Your 
= “ Prescription Cost? It Depends of the State of Michigan. 
on Who You Buy It from 


include Detroit and Grand Rapids, as well as the Upper Peninsula 


Since the sample was drawn purposely, there was confidence 


Many people are sensitive to the costs of their that the survey would lead to some fruitful insights. Not surpris- 

prescription drugs. For some drugs, these costs ingly, the results confirmed the complaints of customers to the 
can make up a significant part of a person’s monthly or yearly attorney general. Prices for the same prescription could vary as 
budget. Generally speaking, however, most people would much as $100, and the variation may exist even though pharma- 
expect that their prescriptions would cost about the same, no cies were quite literally “down the block.” Long term, the use of a 
matter where they buy them. After a number of complaints to carefully drawn sample led to a consumer alert from the attorney 
the contrary, the state of Michigan sought to answer that very general’s office—encouraging customers to shop carefully for 
question. their prescription drugs in the 


The attorney general of the state of Michigan commissioned state. 
a targeted survey of 200 pharmacies to capture drug prescrip- Source tay 2007 RE 
tion costs for 11 common drugs used by people within the state. Survey Summary, Office of the Attorney 
The survey was further focused on 10 specific communities, to General, State of Michigan (May 2007). 


The Sampling Frame 


In practice, the sample will be drawn from a list of population elements that often differs some- 
what from the defined target population. A list of elements from which the sample may be drawn 
is called a sampling frame. The sampling frame is also called the working population because these 


Determine if a probability or nonprobability 
sampling method will be chosen 


v 


Determine sample size 


v 


Select actual sampling units 


v 


sampling frame 


A list of elements from which a 
sample may be drawn; also called 


working population. 


Stages in the Selection 
of a Sample 
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EXHIBIT 


Part 5: Sampling and Fieldwork 


units will eventually provide units involved in analysis. A simple example of a sampling frame 
would be a list of all members of the American Medical Association. 

In practice, almost every list excludes some members of the population. For example, would 
a university e-mail directory provide an accurate sampling frame for a given university’s student 
population? Perhaps the sampling frame excludes students who registered late and includes stu- 
dents who have resigned from the university. The e-mail directory also will likely list only the 
student’s official university e-mail address. However, many students may not ever use this address, 
opting to use a private e-mail account instead. Thus, the university e-mail directory could not be 
expected to perfectly represent the student population. However, a perfect representation isn’t 
always possible or needed. 

Some firms, called sampling services or list brokers, specialize in providing lists or databases 
that include the names, addresses, phone numbers, and e-mail addresses of specific populations. 
Exhibit 16.3 shows a page from a mailing list company’s offerings. Lists offered by companies 
such as this are compiled from subscriptions to professional journals, credit card applications, war- 
ranty card registrations, and a variety of other sources. One sampling service obtained its listing of 
households with children from an ice cream retailer who gave away free ice cream cones on chil- 
dren’s birthdays. The children filled out cards with their names, addresses, and birthdays, which 
the retailer then sold to the mailing list company. 

A valuable source of names is Equifax’s series of city directories. Equifax City Directory provides 
complete, comprehensive, and accurate business and residential information. The city directory 
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Lists Available - alphabetical 


United States | Canadian 


S.1.C. 
Code 


5122-02 
8399-03 
8093-04 
5085-23 
5169-04 
6541-03 
6411-06 
8748-52 
8721-01 

8721-02 
5044-08 
5044-01 

8711-02 
1742-02 
1742-01 

8999-10 
8049-13 
5044-02 
5044-09 
5169-12 
3579-02 
6411-02 
6411-01 

8322-07 
8059-03 
8361-08 
7319-03 
7311-01 

7336-05 
7331-05 
7311-03 
7319-01 
7319-11 
7311-05 
7311-06 
7312-01 
7311-08 


United States | Canadian 


State State 
Total Count S.I.C. EE Total Count 
List Title Count Page Code List Title Count Page 
g 3-03 Ad Radi 59 
; 7313- Meorismg-Rados ss se nees amy e si ness ear 
a ee Ore anizations: hard a H 7311-07 Advertising-Shoppers’ Guides ............ ł 
Abortion Information & a PES, 551 t 5199-17 Advertising-Specialties ................- 52 
A AE ER E S 1811 t 7389-12 Advertising-Telephone $ 
Moe ST a eae 145 ł 7313-05 Advertising-Television + 
NE Se DARA ee 4057 58 7319-02 Advertising-Transit & Transportation ....... t 
dent & Haalthiinsuranee. oas. 0721-03 Aerial Applicators (Service) + 
Accident & Health Insurance ....... 2113 + 
Accident Reconstruction Service 425 t 3999-01. Aerosols 2 i es cise ee ctw es ł 
Accountants oe 427392 64 3812-01 Aerospace Industries ...............0005 ł 
ing a Bookkaon ina General Sve - ink AMG ONE AMOLICANS s zas ireas aana 73 
Accounting & Bookkeeping General Sve ....... 27996 64 7 . 
; ; 7 5191-04 Agricultural Chemicals ................4. t 
Accounting & Bookkeeping Machines/Supls .... 889 $ S 
A ; 8748-20 Agricultural Consultants ..........-.+-.. $ 
Accounting & Bookkeeping Systems .......... 624 $ ` 7 
j 990032 Alr Balaneg: reias soaa ep as + 
Acoustical Consultants .......+.-.+0+e-eeees 381 ł BAe i 
Acoustical Contractors s.s.s... irern 3063 47 5084-64 Air Brushes .......sssssrrrerrrerrrrrs 
Acoustical Materials 878 ł 4512-02 Air Cargo Service. . scs aieas niena nasaan ans 48 
A A 1185 i 5075-01 Air Cleaning & Purifying Equipment........ + 
CHUATI@S «6. eevee eee eee eee eee ie AC pi 
Acupuncture (Acupuncturists) .............--- 2921 62 (Sea Compressors Alr & Gas) 
Adding & Calculating Machines/Supplies ....... 5524 49 5 k pro E eee z 
Addressing Machines & Supplies ............. 345 + 1711-17 Air Conditioning Contractors & Systems .... 
Adhesives & Glues 1187 t *** Available By Brands Sold*** 
Adhesives & Gluing Equipment ........-....- 170 ł ene Roser A OE 
AUTOS S nei aa rA aaa eevee oe eaa = 6164 57 S (2) Patent n ee eee eens 
Adjusters-Public ...... 161 ae eN Ey oes a a z da a aA et a E 
Adoption Agencies .... 1621 + ee ae agic Chef (C) ........... 
Adult Care Facilities 596 $ ae ‘By cee eee eee eee eee ne 
Adult Congregate Living Facilities............. 170 ł iene Gees ear aa 
Advertising-Aerial ............ 00sec eee eeee 337 + TAk is) See eee eee eee eee 
Advertising-Agencies & Counselors ........... 27753 59 Gamtorinaker/ain ‘ar (0) tent e eee 
Advertising-Art Layout & Production Sve ....... 457 ¥ Day & Night (Z) ger (O) .......++--- 
Advertising-Direct Mail n.e .es es senene eseeesr 6347 59 aies H) center eee eee ees 
Advertising-Directory & Guide ............... 2465 $ IE i3 eee eee teen e eens 
Advertising-Displays .............+---++5- 3441 59 GHELTR i a 
Advertising-Indoor .......5.0+-0.seceesees 209 $ ENS wW pene ee eee ees 
Advertising-Motion Picture ...............- 143 È E ee 
Advertising-Newspaper ..............-60-- 4274 59 Poi ee 
Advertising-Outdoor..............-..-+++- 3052 59 Stee ee: 
Advertising-Periodical ............-.--.+5+ 817 $ YENNY = cen veneer een nee ewan 
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records the name of each resident over 18 years of age and lists pertinent information about each 
household. The reverse directory pages offer a unique benefit. A reverse directory provides, in a 
different format, the same information contained in a telephone directory. Listings may be by city 
and street address or by phone number, rather than alphabetical by last name. Such a directory is 
particularly useful when a research wishes to survey only a certain geographical area of a city or 
when census tracts are to be selected on the basis of income or another demographic criterion. 

A sampling frame error occurs when certain sample elements are excluded or when the entire 
population is not accurately represented in the sampling frame. Election polling that used a tele- 
phone directory as a sampling frame would be contacting households with listed phone numbers, 
not households whose members are likely to vote. A better sampling frame might be voter regis- 
tration records. Another potential sampling frame error involving phone records is the possibility 
that a phone survey could underrepresent people with disabilities. Some disabilities, such as hear- 
ing and speech impairments, might make telephone use impossible. However, when researchers in 
Washington State tested for this possible sampling frame error by comparing Census Bureau data 
on the prevalence of disability with the responses to a telephone survey, they found the opposite 
effect. The reported prevalence of a disability was actually higher in the phone survey.” These 
findings could be relevant for research into a community’s health status or the level of demand for 
services for disabled persons. 

As in this example, population elements can be either under- or overrepresented in a sam- 
pling frame. A savings and loan defined its population as all individuals who had savings accounts. 
However, when it drew a sample from the list of accounts rather than from the list of names of 
individuals, individuals who had multiple accounts were overrepresented in the sample. 


SAMPLING FRAMES FOR INTERNATIONAL RESEARCH 


The availability of sampling frames around the globe varies dramatically. Not every country’s gov- 
ernment conducts a census of population. In some countries telephone directories are incomplete, 
no voter registration lists exist, and accurate maps of urban areas are unobtainable. However, in 
Taiwan, Japan, and other Asian countries, a researcher can build a sampling frame relatively eas- 
ily because those governments release some census information. If a family changes households, 
updated census information must be reported to a centralized government agency before com- 
munal services (water, gas, electricity, education, and so on) are made available.’ This information 
is then easily accessible in the local Inhabitants’ Register. 


Sampling Units 


During the actual sampling process, the elements of the population must be selected according to a 
certain procedure. The sampling unit is a single element or group of elements subject to selection 
in the sample. For example, if an airline wishes to sample passengers, it may take every 25th name 
on a complete list of passengers. In this case the sampling unit would be the same as the element. 
Alternatively, the airline could first select certain flights as the sampling unit and then select certain 
passengers on each flight. In this case the sampling unit would contain many elements. 

If the target population has first been divided into units, such as airline flights, additional ter- 
minology must be used. A unit selected in the first stage of sampling is called a primary sampling 
unit (PSU). A unit selected in a successive stages of sampling is called a secondary sampling unit or 
(if three stages are necessary) tertiary sampling unit. When there is no list of population elements, 
the sampling unit generally is something other than the population element. In a random-digit 
dialing study, the sampling unit will be telephone numbers. 


Random Sampling and Nonsampling Errors 


An advertising agency sampled a small number of shoppers in grocery stores that used Shopper’s 
Video, an in-store advertising network. The agency hoped to measure brand awareness and pur- 
chase intentions. Investigators expected this sample to be representative of the grocery-shopping 
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reverse directory 


A directory similar to a telephone 
directory except that listings 

are by city and street address or 
by phone number rather than 
alphabetical by last name. 


sampling frame error 


An error that occurs when certain 
sample elements are not listed or 
are not accurately represented in 
a sampling frame. 


sampling unit 


A single element or group of 
elements subject to selection in 
the sample. 


primary sampling 

unit (PSU) 

A term used to designate a unit 
selected in the first stage of 
sampling. 


secondary sampling unit 


A term used to designate a unit 
selected in the second stage of 
sampling. 


tertiary sampling unit 


A term used to designate a unit 
selected in the third stage of 
sampling. 
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random sampling error 


The difference between the 
sample result and the result of a 
census conducted using identical 
procedures. 
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population. However, if a difference exists between the value of a sample statistic of interest (for 
example, the sample group’s average willingness to buy the advertised brand) and the value of the 
corresponding population parameter (the population’s average willingness to buy), a statistical error 
has occurred. Two basic causes of differences between statistics and parameters were introduced 
in an earlier chapter and are described below: 


1. random sampling errors 
2. systematic (nonsampling) error 


An estimation made from a sample is not the same as a census count. Random sampling error is 
the difference between the sample result and the result of a census conducted using identical proce- 
dures. Of course, the result of a census is unknown unless one is taken, which is rarely done. Other 
sources of error also can be present. Random sampling error occurs because of chance variation in 
the scientific selection of sampling units. The sampling units, even if properly selected according 
to sampling theory, may not perfectly represent the population, but generally they are reliable esti- 
mates. Our discussion on the process of randomization (a procedure designed to give everyone in 
the population an equal chance of being selected as a sample member) will show that, because ran- 
dom sampling errors follow chance variations, they tend to cancel one another out when averaged. 
This means that properly selected samples generally are good approximations of the population. 
Still, the true population value almost always differs slightly from the sample value, causing a small 
random sampling error. Every once in a while, an unusual sample is selected because too many 
atypical people were included in the sample and a large random sampling error occurred. 


Random Sampling Error 


Random sampling error is a function of sample size. As sample size increases, random sampling 
error decreases. Of course, the resources available will influence how large a sample may be taken. 
It is possible to estimate the random sampling error that may be expected with various sample 
sizes. Suppose a survey of approximately 1,000 people has been taken in Fresno to determine the 
feasibility of a new soccer franchise. Assume that 30 percent of the respondents favor the idea of a 
new professional sport in town. The researcher will know, based on the laws of probability, that 
95 percent of the time a survey of slightly fewer than 900 people will produce results with an error 
of approximately plus or minus 3 percent. If the survey were conducted with only 325 people, the 
margin of error would increase to approximately plus or minus 5 percentage points. This example 
illustrates random sampling errors. 


Systematic Sampling Error 


Systematic (nonsampling) errors result from nonsampling factors, primarily the nature of a 
study’s design and the correctness of execution. These errors are not due to chance fluctuations. 
For example, highly educated respondents are more likely to cooperate with mail surveys than 
poorly educated ones, for whom filling out forms is more difficult and intimidating. Sample 
biases such as these account for a large portion of errors in marketing research. The term sample 
bias is somewhat unfortunate, because many forms of bias are not related to the selection of the 
sample. 

We discussed nonsampling errors in Chapter 8. Errors due to sample selection problems, 
such as sampling frame errors, are systematic (nonsampling) errors and should not be classified as 
random sampling errors. 


Less Than Perfectly Representative Samples 


Random sampling errors and systematic errors associated with the sampling process may combine 
to yield a sample that is less than perfectly representative of the population. Exhibit 16.4 illustrates 
two nonsampling errors (sampling frame error and nonresponse error) related to sample design. 
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Source: Adapted from Cox, Keith K. and Ben M. Enis, The Marketing Research Process (Pacific Palisades, CA: Goodyear, 1972); and Bellenger, Danny N. and Barnet A. 


Greenberg, Marketing Research: A Management Information Approach (Homewood, IL: Richard D. Irwin, 1978), pp. 154-155. 


The total population is represented by the area of the largest square. Sampling frame errors elimi- 
nate some potential respondents. Random sampling error (due exclusively to random, chance 
fluctuation) may cause an imbalance in the representativeness of the group. Additional errors will 
occur if individuals refuse to be interviewed or cannot be contacted. Such nonresponse error may 
also cause the sample to be less than perfectly representative. Thus, the actual sample is drawn from 
a population different from (or smaller than) the ideal. 


Probability versus Nonprobability Sampling 


Several alternative ways to take a sample are available. The main alternative sampling plans may be 
grouped into two categories: probability techniques and nonprobability techniques. 

In probability sampling, every element in the population has a known, nonzero probability of 
selection. The simple random sample, in which each member of the population has an equal prob- 
ability of being selected, is the best-known probability sample. 

In nonprobability sampling, the probability of any particular member of the population 
being chosen is unknown. The selection of sampling units in nonprobability sampling is quite 
arbitrary, as researchers rely heavily on personal judgment. Technically, no appropriate sta- 
tistical techniques exist for measuring random sampling error from a nonprobability sample. 
Therefore, projecting the data beyond the sample is, technically speaking, statistically inappro- 
priate. Nevertheless, as the Research Snapshot on prescription drug costs shows, researchers 
sometimes find nonprobability samples best suited for a specific researcher purpose. As a result, 
nonprobability samples are pragmatic and are used in market research. 


Nonprobability Sampling 


Although probability sampling is preferred, we will discuss nonprobability sampling first to illus- 
trate some potential sources of error and other weaknesses in sampling. 


probability sampling 


A sampling technique in which 
every member of the population 
has a known, nonzero probability 
of selection. 


nonprobability sampling 


A sampling technique in which 
units of the sample are selected 
on the basis of personal judg- 
ment or convenience; the prob- 
ability of any particular member 
of the population being chosen 
is unknown. 
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convenience sampling 


The sampling procedure 

of obtaining those people or 
units that are most conveniently 
available. 


judgment (purposive) 
sampling 


A nonprobability sampling tech- 
nique in which an experienced 
individual selects the sample 
based on personal judgment 
about some appropriate charac- 
teristic of the sample member. 
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Convenience Sampling 


As the name suggests, convenience sampling refers to sampling by obtaining people or units that 
are conveniently available. A research team may determine that the most convenient and econom- 
ical method is to set up an interviewing booth from which to intercept consumers at a shopping 
center. Just before elections, television stations often present person-on-the-street interviews that 
are presumed to reflect public opinion. (Of course, the television station generally warns that the 
survey was “unscientific and random” [sic].) The college professor who uses his or her students has 
a captive sample—convenient, but perhaps not so representative. 

Researchers generally use convenience samples to obtain a large number of completed ques- 
tionnaires quickly and economically, or when obtaining a sample through other means is imprac- 
tical. For example, many Internet surveys are conducted with volunteer respondents who, either 
intentionally or by happenstance, visit an organization’s Web site. Although this method produces 
a large number of responses quickly and at a low cost, selecting all visitors to a Web site is clearly 
convenience sampling. Respondents may not be representative because of the haphazard manner 
by which many of them arrived at the Web site or because of self-selection bias. 

Similarly, research looking for cross-cultural differences in organizational or consumer behav- 
ior typically uses convenience samples. Rather than selecting cultures with characteristics relevant 
to the hypothesis being tested, the researchers conducting these studies often choose cultures to 
which they have access (for example, because they speak the language or have contacts in that 
culture’s organizations). Further adding to the convenience, cross-cultural research often defines 
“culture” in terms of nations, which are easier to identify and obtain statistics for, even though 
many nations include several cultures and some people in a given nation may be more involved 
with the international business or academic community than with a particular ethnic culture.* 
Here again, the use of convenience sampling limits how well the research represents the intended 
population. 

The user of research based on a convenience sample should remember that projecting 
the results beyond the specific sample is inappropriate. Convenience samples are best used for 
exploratory research when additional research will subsequently be conducted with a prob- 
ability sample. 


Judgment Sampling 


Judgment (purposive) sampling is a nonprobability sampling technique in which an experienced 
individual selects the sample based on his or her judgment about some appropriate characteristics 
required of the sample member. Researchers select samples that satisfy their specific purposes, 
even if they are not fully representative. The consumer price index (CPI) is based on a judgment 
sample of market-basket items, housing costs, and other selected goods and services expected to 
reflect a representative sample of items consumed by most Americans. Test-market cities often are 
selected because they are viewed as typical cities whose demographic profiles closely match the 
national profile. A fashion manufacturer regularly selects a sample of key accounts that it believes 
are capable of providing information needed to predict what may sell in the fall. Thus, the sample 
is selected to achieve this specific objective. 

Judgment sampling often is used in attempts to forecast election results. People frequently 
wonder how a television network can predict the results of an election with only 2 percent of 
the votes reported. Political and sampling experts judge which small voting districts approximate 
overall state returns from previous election years; then these bellwether precincts are selected as the 
sampling units. Of course, the assumption is that the past voting records of these districts are still 
representative of the political behavior of the state’s population. 


Quota Sampling 


Suppose a firm wishes to investigate consumers who currently subscribe to an HDTV (high 
definition television) service. The researchers may wish to ensure that each brand of HDTV 
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A American Kennel Club Tries 
~ to Keep Pet Owners out of the 
Doghouse 

The American Kennel Club (AKC) is an organiza- 
tion dedicated to promoting purebred dogs and 
their health and well-being as family companions. So the organi- 
zation commissioned a study to investigate dog ownership and 
the acceptance of dogs in their neighborhoods. The AKC used 
quota sampling in its recent Dog Ownership Study, which set out 
to compare attitudes of dog owners and nonowners, based on 
a sample of one thousand people. In such a small sample of the 
U.S. population, some groups might not be represented, so the 
study design set quotas for completed interviews in age, sex, and 
geographic categories. The primary sampling units for this phone 
survey were selected with random-digit dialing. In the next 
phase of selection, the researchers ensured that respondents 
filled the quotas for each group. They further screened respon- 
dents so that half owned dogs and half did not. 


better education in responsible dog ownership, contributing 

to greater community harmony. The study found that people 
without dogs tended to be most concerned about dogs jumping 
and barking and owners not “picking up after their dogs.” Lisa 
Peterson, director of club communications for AKC, commented, 
“Anyone considering bringing a dog home should realize that 
it’s a 10- to 15-year commitment of time, money, and love that 
should not be taken lightly.” 

The study addressed the pleasures of a pet’s companionship, 
as well as the duties. A benefit of ownership was that dog owners 
were somewhat more likely than nonowners to describe them- 
selves as laid-back and happy. 


Source: “AKC Mission Statement” and “History of the American Kennel Club,” 
American Kennel Club, http://www.akc.org, accessed March 20, 2006; “AKC 
Responsible Dog Ownership Day 
Survey Reveals Rift between Dog and 
Non-Dog Owners,” American Kennel 
Club news release, http://www.akc.org, 
accessed March 20, 2006. 


An objective of the survey was to help dog owners under- 
stand concerns of their neighbors so that the AKC can provide 


televisions is included proportionately in the sample. Strict probability sampling procedures would 
likely underrepresent certain brands and overrepresent other brands. If the selection process were 
left strictly to chance, some variation would be expected. 

As seen in the Research Snapshot above, the purpose of quota sampling is to ensure that the 
various subgroups in a population are represented on pertinent sample characteristics to the exact 
extent that the investigators desire. Stratified sampling, a probability sampling procedure described 
in the next section, also has this objective, but it should not be confused with quota sampling. In 
quota sampling, the interviewer has a quota to achieve. For example, an interviewer in a particular 
city may be assigned 100 interviews, 35 with owners of Sony TVs, 30 with owners of Samsung 
TVs, 18 with owners of Panasonic TVs, and the rest with owners of other brands. The interviewer 
is responsible for finding enough people to meet the quota. Aggregating the various interview 
quotas yields a sample that represents the desired proportion of each subgroup. 


POSSIBLE SOURCES OF BIAS 


The logic of classifying the population by pertinent subgroups is essentially sound. However, 
because respondents are selected according to a convenience sampling procedure rather than on a 
probability basis (as in stratified sampling), the haphazard selection of subjects may introduce bias. 
For example, a college professor hired some of his students to conduct a quota sample based on 
age. When analyzing the data, the professor discovered that almost all the people in the “under 
25 years” category were college-educated. Interviewers, being human, tend to prefer to interview 
people who are similar to themselves. 

Quota samples tend to include people who are easily found, willing to be interviewed, and 
middle class. Fieldworkers are given considerable leeway to exercise their judgment concerning 
selection of actual respondents. Interviewers often concentrate their interviewing in areas with 
heavy pedestrian traffic such as downtowns, shopping malls, and college campuses. Those who 
interview door-to-door learn quickly that quota requirements are difficult to meet by interview- 
ing whoever happens to appear at the door. People who are more likely to stay at home generally 
share a less active lifestyle and are less likely to be meaningfully employed. One interviewer related 
a story of working in an upper-middle-class neighborhood. After a few blocks, he arrived in a 
neighborhood of mansions. Feeling that most of the would-be respondents were above his station, 
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quota sampling 


A nonprobability sampling pro- 
cedure that ensures that various 
subgroups of a population will 
be represented on pertinent 
characteristics to the exact extent 
that the investigator desires. 
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snowball sampling 


A sampling procedure in which 
initial respondents are selected 
by probability methods and addi- 
tional respondents are obtained 
from information provided by the 
initial respondents. 


—Albert Einstein 


simple random sampling 


A sampling procedure that 
assures each element in the 
population of an equal chance of 
being included in the sample. 
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the interviewer skipped these houses because he felt uncomfortable knocking on doors that would 
be answered by these people or their hired help. 


ADVANTAGES OF QUOTA SAMPLING 


The major advantages of quota sampling over probability sampling are speed of data collection, 
lower costs, and convenience. Although quota sampling has many problems, carefully supervised 
data collection may provide a representative sample of the various subgroups within a population. 
Quota sampling may be appropriate when the researcher knows that a certain demographic group 
is more likely to refuse to cooperate with a survey. For instance, if older men are more likely to 
refuse, a higher quota can be set for this group so that the proportion of each demographic cat- 
egory will be similar to the proportions in the population. A number of laboratory experiments 
also rely on quota sampling because it is difficult to find a sample of the general population willing 
to visit a laboratory to participate in an experiment. 


Snowball Sampling 


A variety of procedures known as snowball sampling involve using probability methods for an 
initial selection of respondents and then obtaining additional respondents through information 
provided by the initial respondents. This technique is used to locate members of rare populations 
by referrals. Suppose a manufacturer of sports equipment is considering marketing a mahogany 
croquet set for serious adult players. This market is certainly small. An extremely large sample 
would be necessary to find 100 serious adult croquet players. It would be much more economical 
to survey, say, 300 people, find 15 croquet players, and ask them for the names of other players. 

Reduced sample sizes and costs are clear-cut advantages of snowball sampling. However, bias 
is likely to enter into the study because a person suggested by someone also in the sample has a 
higher probability of being similar to the first person. If there are major differences between those 
who are widely known by others and those who are not, this technique may present some serious 
problems. However, snowball sampling may be used to locate and recruit heavy users, such as 
consumers who buy more than 50 compact discs per year, for focus groups. As the focus group is 
not expected to be a generalized sample, snowball sampling may be appropriate. 


Probability Sampling 


All probability sampling techniques are based on chance selection procedures. Because the prob- 
ability sampling process is random, the bias inherent in nonprobability sampling procedures is 
eliminated. Note that the term random refers to the procedure for selecting the sample; it does not 
describe the data in the sample. Randomness characterizes a procedure whose outcome cannot be 
predicted because it depends on chance. Randomness should not be thought of as unplanned or 
unscientific—tt is the basis of all probability sampling techniques. This section will examine the 
various probability sampling methods. 


Simple Random Sampling 


The sampling procedure that ensures each element in the population will have an equal chance of 
being included in the sample is called simple random sampling. Examples include drawing names 
from a hat and selecting the winning raffle ticket from a large drum. If the names or raffle tickets 
are thoroughly stirred, each person or ticket should have an equal chance of being selected. In 
contrast to other, more complex types of probability sampling, this process is simple because it 
requires only one stage of sample selection. 

Although drawing names or numbers out of a fishbowl, using a spinner, rolling dice, or turn- 
ing a roulette wheel may be an appropriate way to draw a sample from a small population, when 
populations consist of large numbers of elements, sample selection is based on tables of random 
numbers (see Table A.1 in the Appendix) or computer-generated random numbers. 
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or row, moving up, down, left, or right. A random starting point should be selected at the outset. 
For convenience, we will assume that we have randomly selected as our starting point the first 
five digits in columns 1 through 5, row 1, of Table A.1 in the Appendix. The first number in our 
sample would be 37751; moving down, the next numbers would be 50915, 99142, and so on. 

The random-digit dialing technique of sample selection requires that the researcher identify 
the exchange or exchanges of interest (the first three numbers) and then use a table of numbers 
to select the next four numbers. In practice, the exchanges are not always selected randomly. 
Researchers who wanted to find out whether Americans of African descent prefer being called 
“black” or “African-American” narrowed their sampling frame by selecting exchanges associated 
with geographic areas where the proportion of the population (African-Americans/blacks) was 
at least 30 percent. The reasoning was that this made the survey procedure far more efficient, 
considering that the researchers were trying to contact a group representing less than 15 percent 
of U.S. households. This initial judgment sampling raises the same issues we discussed regarding 
nonprobability sampling. In this study, the researchers found that respondents were most likely 
to prefer the term black if they had attended schools that were about half black and half white. If 
such experiences influence the answers to the question of interest to the researchers, the fact that 
blacks who live in predominantly white communities are underrepresented may introduce bias 
into the results. 


Systematic Sampling 


Suppose a researcher wants to take a sample of 1,000 from a list of 200,000 names. With systematic 
sampling, every 200th name from the list would be drawn. The procedure is extremely simple. 
A starting point is selected by a random process; then every nth number on the list is selected. 
To take a sample of consumers from a rural telephone directory that does not separate business 
from residential listings, every 23rd name might be selected as the sampling interval. In the process, 
Mike’s Restaurant might be selected. This unit is inappropriate because it is a business listing 
rather than a consumer listing, so the next eligible name would be selected as the sampling unit, 
and the systematic process would continue. 

While systematic sampling is not actually a random selection procedure, it does yield random 
results if the arrangement of the items in the list is random in character. The problem of periodicity 
occurs if a list has a systematic pattern—that is, if it is not random in character. Collecting retail sales 
information every seventh day would result in a distorted sample because there would be a sys- 
tematic pattern of selecting sampling units—sales for only one day of the week (perhaps Monday) 
would be sampled. If the first 50 names on a list of contributors to a charity were extremely large 
donors, periodicity bias might occur in sampling every 200th name. Periodicity is rarely a problem 
for most sampling in marketing research, but researchers should be aware of the possibility. 


Random number tables are 
also found on the Internet. This 
is just one example. 


systematic sampling 


A sampling procedure in which 
a starting point is selected by 

a random process and then 
every nth number on the list 

is selected. 
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stratified sampling 


A probability sampling proce- 
dure in which simple random 
subsamples that are more or less 
equal on some characteristic are 
drawn from within each stratum 
of the population. 


proportional stratified 
sample 


A stratified sample in which the 
number of sampling units drawn 
from each stratum is in propor- 
tion to the population size of that 
stratum. 


disproportional stratified 
sample 


A stratified sample in which the 
sample size for each stratum is 
allocated according to analytical 
considerations. 
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Stratified Sampling 


The usefulness of dividing the population into subgroups, or strata, whose members are more or 
less equal with respect to some characteristic was illustrated in our discussion of quota sampling. 
The first step is the same for both stratified and quota sampling: choosing strata on the basis of 
existing information—for example, classifying retail outlets based on annual sales volume. How- 
ever, the process of selecting sampling units within the strata differs substantially. In stratified 
sampling, a subsample is drawn using simple random sampling within each stratum. This is not 
true of quota sampling. 

The reason for taking a stratified sample is to obtain a more efficient sample than would be 
possible with simple random sampling. Suppose, for example, that urban and rural groups have 
widely different attitudes toward energy conservation, but members within each group hold very 
similar attitudes. Random sampling error will be reduced with the use of stratified sampling, 
because each group is internally homogeneous but there are comparative differences between 
groups. More technically, a smaller standard error may result from this stratified sampling because 
the groups will be adequately represented when strata are combined. 

Another reason for selecting a stratified sample is to ensure that the sample will accurately 
reflect the population on the basis of the criterion or criteria used for stratification. This is a con- 
cern because occasionally simple random sampling yields a disproportionate number of one group 
or another and the sample ends up being less representative than it could be. 

A researcher can select a stratified sample as follows. First, a variable (sometimes several vari- 
ables) is identified as an efficient basis for stratification. A stratification variable must be a char- 
acteristic of the population elements known to be related to the dependent variable or other 
variables of interest. The variable chosen should increase homogeneity within each stratum and 
increase heterogeneity between strata. The stratification variable usually is a categorical variable or 
one easily converted into categories (that is, subgroups). For example, a pharmaceutical company 
interested in measuring how often physicians prescribe a certain drug might choose physicians’ 
training as a basis for stratification. In this example the mutually exclusive strata are MDs (medical 
doctors) and ODs (osteopathic doctors). 

Next, for each separate subgroup or stratum, a list of population elements must be obtained. (If 
such lists are not available, they can be costly to prepare, and if a complete listing is not available, 
a true stratified probability sample cannot be selected.) Using a table of random numbers or some 
other device, a separate simple random sample is then taken within each stratum. Of course, the 
researcher must determine how large a sample to draw for each stratum. This issue is discussed in 
the following section. 


Proportional versus Disproportional Sampling 


If the number of sampling units drawn from each stratum is in proportion to the relative popula- 
tion size of the stratum, the sample is a proportional stratified sample. Sometimes, however, a dis- 
proportional stratified sample will be selected to ensure an adequate number of sampling units in 
every stratum. Sampling more heavily in a given stratum than its relative population size warrants 
is not a problem if the primary purpose of the research is to estimate some characteristic separately 
for each stratum and if researchers are concerned about assessing the differences among strata. 
Consider, however, the percentages of retail outlets presented in Exhibit 16.5. A proportional 
sample would have the same percentages as in the population. Although there is a small percentage 
of warehouse club stores, the average dollar sales volume for the warehouse club store stratum is 
quite large and varies substantially from the average store size for the smaller independent stores. 
To avoid overrepresenting the chain stores and independent stores (with smaller sales volume) in 
the sample, a disproportional sample is taken. 

In a disproportional stratified sample the sample size for each stratum is not allocated in pro- 
portion to the population size but is dictated by analytical considerations, such as variability in 
store sales volume. The logic behind this procedure relates to the general argument for sample size: 
As variability increases, sample size must increase to provide accurate estimates. Thus, the strata 
that exhibit the greatest variability are sampled more heavily to increase sample efficiency—that 
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Percentage in Proportional Disproportional 
Population Sample Sample 


= i, == Warehouse Clubs 20% 


4 7) Chain Stores 


Small Independents 


is, produce smaller random sampling error. Complex formulas (beyond the scope of an introduc- 
tory course in business research) have been developed to determine sample size for each stratum. 
A simplified rule of thumb for understanding the concept of optimal allocation is that the stratum 
sample size increases for strata of larger sizes with the greatest relative variability. Other complexi- 
ties arise in determining population estimates. For example, when disproportional stratified sam- 
pling is used, the estimated mean for each stratum has to be weighed according to the number of 
elements in each stratum in order to calculate the total population mean. 


Cluster Sampling 


The purpose of cluster sampling is to sample economically while retaining the characteristics of a 
probability sample. Consider a researcher who must conduct five hundred personal interviews with 
consumers scattered throughout the United States. Travel costs are likely to be enormous because 
the amount of time spent traveling will be substantially greater than the time spent in the interview- 
ing process. If an aspirin marketer can assume the product will be equally successful in Phoenix and 
Baltimore, or ifa frozen pizza manufacturer assumes its product will suit the tastes of Texans equally 
as well as Oregonians, cluster sampling may be used to represent the United States. 

In a cluster sample, the primary sampling unit is no longer the individual element in the popula- 
tion (for example, grocery stores) but a larger cluster of elements located in proximity to one another 
(for example, cities). The area sample is the most popular type of cluster sample. A grocery store 
researcher, for example, may randomly choose several geographic areas as primary sampling units and 
then interview all or a sample of grocery stores within the geographic clusters. Interviews are confined 
to these clusters only. No interviews occur in other clusters. Cluster sampling is classified as a prob- 
ability sampling technique because of either the random selection of clusters or the random selection 
of elements within each cluster. Some examples of clusters appear in Exhibit 16.6 on the next page. 

Cluster samples frequently are used when lists of the sample population are not available. For 
example, when researchers investigating employees and self-employed workers for a downtown 
revitalization project found that a comprehensive list of these people was not available, they 
decided to take a cluster sample, selecting organizations (business and government) as the clusters. 
A sample of firms within the central business district was developed, using stratified probability 
sampling to identify clusters. Next, individual workers within the firms (clusters) were randomly 
selected and interviewed concerning the central business district. 

Ideally a cluster should be as heterogeneous as the population itself—a mirror image of the 
population. A problem may arise with cluster sampling if the characteristics and attitudes of the 
elements within the cluster are too similar. For example, geographic neighborhoods tend to have 
residents of the same socioeconomic status. Students at a university tend to share similar beliefs. 
This problem may be mitigated by constructing clusters composed of diverse elements and by 
selecting a large number of sampled clusters. 
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EXHIBIT 16.5 
Disproportional Sampling: 
Hypothetical Example 


cluster sampling 


An economically efficient sam- 
pling technique in which the 
primary sampling unit is not 

the individual element in the 
population but a large cluster of 
elements; clusters are selected 
randomly. 
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Who’s at Home? Different Ways 
to Select Respondents 

A carefully planned telephone survey often involves multistage 
sampling. First the researchers select a sample of households 
to call, and then they select someone within each household to 
interview—not necessarily whoever answers the phone. Cecilie 
Gaziano, a researcher with Research Solutions in Minneapolis, 
conducted an analysis of various selection procedures used in 
prior research, looking for the methods that performed best in 
terms of generating a representative sample, achieving respon- 
dent cooperation, and minimizing costs. 

Gaziano found several 
methods worth further con- 
sideration. One of these was 
full enumeration, in which 
the interviewer requests a 
list of all the adults living in 
the household, generates a 
random number, uses the 
number to select a name from 
that list, and asks to speak 
with that person. In a variation 
of this approach, called the 


Examples of Clusters 


Population Element 


U.S. adult population 


College seniors 


Manufacturing firms 


Airline travelers 


Sports fans 


Kish method, the interviewer requests the 
number of males by age and the number of 
females by age, and then uses some form of 
randomization to select either a male or a 
female and a number—say, the oldest male 
or the third oldest female. A third method is to 

interview the person who last had a birthday. 

In the studies Gaziano examined, the Kish method did not 
seem to discourage respondents by being too intrusive. That 
method was popular because it came close to being random. 
The last-birthday method generated somewhat better cooper- 
ation rates, which may have made that method more efficient 
in terms of costs. However, some question whether the person 
on the phone accurately knows the birthdays of every house- 
hold member, especially in households with several adults. 
Methods that request the gender of household members also 
address a challenge of getting a representative phone survey 
sample: females tend to answer the phone more often than 
males. 

Source: Gaziano, Cecilie, “Comparative Analysis of Within-Household Respondent 
Selection Techniques,” Public Opinion Quarterly 69 (Spring 2005), 124-157; 


“Communication Researchers and Policy-Making,” Journal of Broadcasting & Electronic 
Media (March 2004), http://www.allbusiness.com, accessed March 19, 2006. 


Possible Clusters in the United States 


States 

Counties 

Metropolitan Statistical Areas 
Census Tracts 

Blocks 

Households 


Colleges 


Counties 

Metropolitan Statistical Areas 
Localities 

Plants 


Airports 
Planes 


Football Stadiums 
Basketball Arenas 
Baseball Parks 


Multistage Area Sampling 


multistage area sampling 


Sampling that involves using 
a combination of two or more 
probability sampling techniques. 
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So far we have described two-stage cluster sampling. Multistage area sampling involves two or 
more steps that combine some of the probability techniques already described. Typically, geo- 
graphic areas are randomly selected in progressively smaller (lower-population) units. For example, 
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a political pollster investigating an election in Arizona might first choose counties within the state 
to ensure that the different areas are represented in the sample. In the second step, precincts 
within the selected counties may be chosen. As a final step, the pollster may select blocks (or 
households) within the precincts, then interview all the blocks (or households) within the geo- 
graphic area. Researchers may take as many steps as necessary to achieve a representative sample. 
Exhibit 16.7 graphically portrays a multistage area sampling process frequently used by a major 
academic research center. Progressively smaller geographic areas are chosen until a single housing 
unit is selected for interviewing. 

The Bureau of the Census provides maps, population information, demographic character- 
istics for population statistics, and so on, by several small geographical areas; these may be useful 
in sampling. Census classifications of small geographical areas vary, depending on the extent of 
urbanization within Metropolitan Statistical Areas (MSAs) or counties. Exhibit 16.8 on the next 
page illustrates the geographic hierarchy inside urbanized areas. 


EXHIBIT 16.7 Illustration of Multistage Area Sampling 
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Source: From /nterviewer’s Manual, Revised Edition (Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan, 1976), p. 36. 


Reprinted by permission. 


403 


404 Part 5: Sampling and Fieldwork 


EXHIBIT 16.8 
Geographic Hierarchy inside 
Urbanized Areas 
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Source: From U.S. Bureau of the Census, “Geography—Concepts and Products,” Washington, DC, August 1985, p. 3. 


What Is the Appropriate Sample Design? 


A researcher who must decide on the most appropriate sample design for a specific project will 
identify a number of sampling criteria and evaluate the relative importance of each criterion before 
selecting a sampling design. This section outlines and briefly discusses the most common criteria. 
Exhibit 16.9 summarizes the advantages and disadvantages of each nonprobability sampling tech- 
nique, and Exhibit 16.10 does the same for the probability sampling techniques. 


Degree of Accuracy 


Selecting a representative sample is important to all researchers. However, the degree of accuracy 
required or the researcher’s tolerance for sampling and nonsampling error may vary from project 
to project, especially when cost savings or another benefit may be a trade-off for a reduction in 
accuracy. 


EXHIBIT 16.9 Comparison of Sampling Techniques: Nonprobability Samples 


Nonprobability Samples 


Description 


Cost and Degree of Use 


Advantages 


Disadvantages 


1. Convenience: The researcher 
uses the most convenient sample 
or economical sample units. 


2. Judgment: An expert or 
experienced researcher selects the 
sample to fulfill a purpose, such as 
ensuring that all members have a 
certain characteristic. 


3. Quota: The researcher classifies 
the population by pertinent 
properties, determines the desired 
proportion to sample from each 
class, and fixes quotas for each 
interviewer. 


4. Snowball: Initial respondents are 
selected by probability samples; 
additional respondents are 
obtained by referral from initial 
respondents. 


Very low cost, extensively 
used 


Moderate cost, average use 


Moderate cost, very 
extensively used 


Low cost, used in special 
situations 


No need for list of 
population 


Useful for certain types 
of forecasting; sample 
guaranteed to meet a 
specific objective 


Introduces some stratification 
of population; requires no list 
of population 


Useful in locating members 
of rare populations 


Unrepresentative samples likely; 
random sampling error estimates 
cannot be made; projecting data 
beyond sample is relatively risky 


Bias due to expert's beliefs may 
make sample unrepresentative; 
projecting data beyond sample 
is risky 


Introduces bias in researcher's 
classification of subjects; 
nonrandom selection within classes 
means error from population 
cannot be estimated; projecting 
data beyond sample is risky 


High bias because sample units 
are not independent; projecting 
data beyond sample is risky 
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Comparison of Sampling Techniques: Probability Samples 


Description 


Probability Samples 


Cost and Degree of Use 


Advantages 


405 


Disadvantages 


1. Simple random: The researcher 
assigns each member of the 
sampling frame a number, then 
selects sample units by random 
method. 


2. Systematic: The researcher uses 
natural ordering or the order 

of the sampling frame, selects 

an arbitrary starting point, then 
selects items at a preselected 
interval. 


3. Stratified: The researcher divides 
the population into groups and 
randomly selects subsamples from 
each group. Variations include 
proportional, disproportional, and 
optimal allocation of subsample 
sizes. 


4. Cluster: The researcher selects 
sampling units at random, then 
does a complete observation of 
all units or draws a probability 
sample in the group. 


5. Multistage: Progressively smaller 
areas are selected in each stage by 
some combination of the first four 
techniques. 


High cost, moderately used 
in practice (most common in 
random digit dialing and 
with computerized sampling 
frames) 


Moderate cost, moderately 
used 


High cost, moderately used 


Low cost, frequently used 


High cost, frequently used, 
especially in nationwide 
surveys 


Only minimal advance knowledge 
of population needed; easy to 
analyze data and compute error 


Simple to draw sample; easy 
to check 


Ensures representation of 

all groups in sample; 
characteristics of each stratum can 
be estimated and comparisons 
made; reduces variability for same 
sample size 


If clusters geographically defined, 
yields lowest field cost; requires 
listing of all clusters, but of 
individuals only within clusters; 
can estimate characteristics of 
clusters as well as of population 


Depends on techniques 
combined 


Requires sampling frame to work 
from; does not use knowledge 

of population that researcher 
may have; larger errors for same 
sampling size than in stratified 
sampling; respondents may be 
widely dispersed, hence cost may 
be higher 


If sampling interval is related 
to periodic ordering of the 
population, may introduce 
increased variability 


Requires accurate information 
on proportion in each stratum; 
if stratified lists are not already 
available, they can be costly to 
prepare 


Larger error for comparable 

size than with other probability 
samples; researcher must be able 
to assign population members 
to unique cluster or else 
duplication or omission of 
individuals will result 


Depends on techniques 
combined 


For example, when the sample is being selected for an exploratory research project, a high 


priority may not be placed on accuracy because a highly representative sample may not be neces- 
sary. For other, more conclusive projects, the sample result must precisely represent a population’s 
characteristics, and the researcher must be willing to spend the time and money needed to achieve 
accuracy. 


Resources 


The cost associated with the different sampling techniques varies tremendously. If the researcher’s 
financial and human resources are restricted, certain options will have to be eliminated. For a 
graduate student working on a master’s thesis, conducting a national survey is almost always out of 
the question because of limited resources. Managers concerned with the cost of the research ver- 
sus the value of the information often will opt to save money by using a nonprobability sampling 
design rather than make the decision to conduct no research at all. 


Time 


A researcher who needs to meet a deadline or complete a project quickly will be more likely to 
select a simple, less time-consuming sample design. As seen in the Research Snapshot on page 402 
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to College Life 


New on Campus: Student Adjustment 


in negative coping behaviors or who had 
perfectionist tendencies would more likely 


Transitions to new jobs, new cities, or new work environments have poor adjustment outcomes after the 

can create physical and emotional stress on people. Stress and first year. However, for those students who 

tension can also impact students when they first arrive at a were optimistic and socially oriented, these 

college and university. The new environment, new classroom students were much more likely to adjust to the 

experience, and a lack of friends can create psychological dis- new college environment. 

tress that can lead to alcohol or substance abuse, physical health The use of a panel approach was necessary, since the 

concerns, and mental stresses or strains. The question is how researchers were interested in the change that occurred within 

students adjust to this new environment. To answer this ques- a sample of students over time. These results can be used by 

tion, researchers had to conduct a panel study, where incoming college administrators to develop newcomer programs or experi- 

students were assessed on their psychological traits and coping ences that students can use to adjust to their new college envi- 
behaviors upon entry, and ronment. College is stressful enough—it is critical that new stu- 
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were then resurveyed at the dents understand that help and support are there if they need it! 


Ene O tinei MiS: year. Source: Pritchard, M.E. G. S. Wilson, and B. Yamnitz, “What Predicts Adjustment 
The results indicate that Among College Students? A Longitudinal Study,” Journal of American College 


those students who engaged Health 56, no. 1 (2007), 15-21. 


a telephone survey that uses a sample based on random-digit dialing, when conducted carefully, 
takes considerably less time than a survey that uses an elaborate disproportional stratified sample. 


Advance Knowledge of the Population 


Advance knowledge of population characteristics, such as the availability of lists of population 
members, is an important criterion. In many cases, however, no list of population elements will 
be available to the researcher. This is especially true when the population element is defined by 
ownership of a particular product or brand, by experience in performing a specific job task, or on 
a qualitative dimension. A lack of adequate lists may automatically rule out systematic sampling, 
stratified sampling, or other sampling designs, or it may dictate that a preliminary study, such as a 
short telephone survey using random digit dialing, be conducted to generate information to build 
a sampling frame for the primary study. In many developing countries, things like reverse directo- 
ries are rare. Thus, researchers planning sample designs have to work around this limitation. 


National versus Local Project 


Geographic proximity of population elements will influence sample design. When population 
elements are unequally distributed geographically, a cluster sample may become much more 
attractive. 


Internet Sampling Is Unique 


Internet surveys allow researchers to reach a large sample rapidly—both an advantage and a disad- 
vantage. Sample size requirements can be met overnight or in some cases almost instantaneously. 
A researcher can, for instance, release a survey during the morning in the Eastern Standard Time 
zone and have all sample size requirements met before anyone on the West Coast wakes up. If 
rapid response rates are expected, the sample for an Internet survey should be metered out across 
all time zones. In addition, people in some populations are more likely to go online during the 
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weekend than on a weekday. If the researcher can anticipate a day-of-the-week effect, the survey 
should be kept open long enough so that all sample units have the opportunity to participate in 
the research project. 

The ease and low cost of an Internet survey also has contributed to a flood of online question- 
naires, some more formal than others. As a result, frequent Internet users may be more selective 
about which surveys they bother answering. Researchers investigating college students’ attitudes 
toward environmental issues found that those who responded to an e-mail request that had been 
sent to all students tended to be more concerned about the environment than students who were 
contacted individually through systematic sampling. The researchers concluded that students who 
cared about the issues were more likely to respond to the online survey.° 

Another disadvantage of Internet surveys is the lack of computer ownership and Internet 
access among certain segments of the population. A sample of Internet users is representative only 
of Internet users, who tend to be younger, better educated, and more affluent than the general 
population. This is not to say that all Internet samples are unrepresentative of all target popula- 
tions. Nevertheless, when using Internet surveys, researchers should be keenly aware of potential 
sampling problems that can arise due to systematic characteristics of heavy computer users. 


Web Site Visitors 


As noted earlier, many Internet surveys are conducted with volunteer respondents who visit an 
organization’s Web site intentionally or by happenstance. These unrestricted samples are clearly 
convenience samples. They may not be representative because of the haphazard manner by which 
many respondents arrived at a particular Web site or because of self-selection bias. 

A better technique for sampling Web site visitors is to randomly select sampling units. Survey- 
Site, a company that specializes in conducting Internet surveys, collects data by using its “pop-up 
survey” software. The software selects Web visitors at random and “pops up” a small JavaScript 
window asking the person if he or she wants to participate in an evaluation survey. If the person 
clicks yes, a new window containing the online survey opens up. The person can then browse the 
site at his or her own pace and switch to the survey at any time to express an opinion.’ 

Randomly selecting Web site visitors can cause a problem. It is possible to overrepresent 
frequent visitors to the site and thus represent site visits rather than visitors. Several programming 
techniques and technologies (using cookies, registration data, or prescreening) are available to 
help accomplish more representative sampling based on site traffic.* Details of these techniques are 
beyond the scope of this discussion. 

This type of random sampling is most valuable if the target population is defined as visitors to 
a particular Web site. Evaluation and analysis of visitors’ perceptions and experiences of the Web 
site would be a typical survey objective with this type of sample. Researchers who have broader 
interests may obtain Internet samples in a variety of other ways. 


Panel Samples 


Drawing a probability sample from an established consumer panel or other prerecruited membership 
panel is a popular, scientific, and effective method for creating a sample of Internet users. Typically, 
sampling from a panel yields a high response rate because panel members have already agreed to 
cooperate with the research organization’s e-mail or Internet surveys. Often panel members are 
compensated for their time with a sweepstakes, a small cash incentive, or redeemable points. Further, 
because the panel has already supplied demographic characteristics and other information from 
previous questionnaires, researchers are able to select panelists based on product ownership, lifestyle, 
or other characteristics. As seen in the Research Snapshots on the Current Population Survey and 
student adjustment, a variety of sampling methods and data transformation techniques can be applied 
to ensure that sample results are representative of the general public or a targeted population. 
Consider Harris Interactive Inc., an Internet survey research organization that maintains a 
panel of more than 6.5 million individuals in the United States. In the early twenty-first cen- 
tury, Harris plans to expand this panel to between 10 million and 15 million and to include an 
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e Business research rarely requires a census. are representative of the target 
e Accurately defining the target population is critical in population. 
research involving forecasts of how that population will e Convenience samples do have appropri- 
react to some event. Consider the following in defining the ate uses in behavioral research. Convenience 
population. samples are particularly appropriate when: 
e Who are we not interested in? e Exploratory research is conducted. 
e What are the relevant market segment characteristics e The researcher is primarily interested in internal validity 
involved? (testing a hypothesis under any condition) rather than 
e Is region important in defining the target population? external validity (understanding how much the sample 
e Is the issue being studied relevant to multiple results project to a target population). 
populations? e When cost and time constraints only allow a convenience 
e Isa list available that contains all members of the sample: 
population? - Researchers can think backwards and project the 
e Online panels are a practical reality in survey research. A sam- population for whom the results apply to based on 
ple can be quickly measured that matches the demographic the nature of the convenience sample. 
profiles of the target population. e Researchers seldom have a perfectly representative sample. 
e As with all panels, the researcher faces a risk that system- Thus, the report should qualify the generalizability of the 
atic error is introduced in some way. For example, this results based on sample limitations. 


sample may be higher in willingness to give opinions or 
may be responding only for an incentive. 

e The researcher should take extra steps such as including 
more screening questions to make sure the responses 
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additional 10 million people internationally.’ A database this large allows the company to draw 
simple random samples, stratified samples, and quota samples from its panel members. 

Harris Interactive finds that two demographic groups are not fully accessible via Internet sam- 
pling: people ages 65 and older—a group that is rapidly growing—and those with annual incomes 
of less than $15,000. In contrast, 18- to 25-year-olds—a group that historically has been very hard 
to reach by traditional research methods—are now extremely easy to reach over the Internet.'” 

To ensure that survey results are representative, Harris Interactive uses a propensity-weighting 
scheme. The research company does parallel studies—by phone as well as over the Internet—to 
test the accuracy of its Internet data-gathering capabilities. Researchers look at the results of the 
telephone surveys and match those against the Internet-only survey results. Next, they use pro- 
pensity weighting to adjust the results, taking into account the motivational and behavioral dif- 
ferences between the online and offline populations. (How propensity weighting adjusts for the 
difference between the Internet population and the general population is beyond the scope of this 
discussion.) 


Recruited Ad Hoc Samples 


Another means of obtaining an Internet sample is to obtain or create a sampling frame of e-mail 
addresses on an ad hoc basis. Researchers may create the sampling frame offline or online. Databases 
containing e-mail addresses can be compiled from many sources, including customer/client lists, 
advertising banners on pop-up windows that recruit survey participants, online sweepstakes, and 
registration forms that must be filled out in order to gain access to a particular Web site. Research- 
ers may contact respondents by “snail mail” or by telephone to ask for their e-mail addresses and 
obtain permission for an Internet survey. Using offline techniques, such as random-digit dialing 
and short telephone screening interviews, to recruit respondents can be a very practical way to get 
a representative sample for an Internet survey. Companies anticipating future Internet research can 
develop a valuable database for sample recruitment by including e-mail addresses in their customer 
relationship databases (by inviting customers to provide that information on product registration 
cards, in telephone interactions, through on-site registration, etc.)."' 
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Opt-in Lists 


Survey Sampling International specializes in providing sampling frames and scientifically drawn 
samples. The company offers more than 3,500 lists of high-quality, targeted e-mail addresses of 
individuals who have given permission to receive e-mail messages related to a particular topic of 
interest. Survey Sampling International’s database contains millions of Internet users who opt in 
for limited participation. An important feature of Survey Sampling International’s database is that 
the company has each individual confirm and reconfirm interest in communicating about a topic 
before the person’s e-mail address is added to the company’s database.’ 

By whatever technique the sampling frame is compiled, it is important not to send unau- 
thorized e-mail to respondents. If individuals do not opt in to receive e-mail from a particular 
organization, they may consider unsolicited survey requests to be spam. A researcher cannot 
expect high response rates from individuals who have not agreed to be surveyed. Spamming is 
not tolerated by experienced Internet users and can easily backfire, creating a host of problems— 
the most extreme being complaints to the Internet service provider (ISP), which may shut down 
the survey site. 


Summary 


1. Explain reasons for taking a sample rather than a complete census. Sampling is a procedure 
that uses a small number of units of a given population as a basis for drawing conclusions about 
the whole population. Sampling often is necessary because it would be practically impossible to 
conduct a census to measure characteristics of all units of a population. Samples also are needed 
in cases where measurement involves destruction of the measured unit. 


2. Describe the process of identifying a target population and selecting a sampling frame. The 
first problem in sampling is to define the target population. Incorrect or vague definition of this 
population is likely to produce misleading results. A sampling frame is a list of elements, or indi- 
vidual members, of the overall population from which the sample is drawn. A sampling unit is a 
single element or group of elements subject to selection in the sample. 


3. Compare random sampling and systematic (nonsampling) errors. There are two sources of 
discrepancy between the sample results and the population parameters. One, random sampling 
error, arises from chance variations of the sample from the population. Random sampling error 
is a function of sample size and may be estimated using the central-limit theorem, discussed in 
Chapter 17. Systematic, or nonsampling, error comes from sources such as sampling frame error, 
mistakes in recording responses, or nonresponses from persons who are not contacted or who 
refuse to participate. 


4. Identify the types of nonprobability sampling, including their advantages and disadvan- 
tages. The two major classes of sampling methods are probability and nonprobability techniques. 
Nonprobability techniques include convenience sampling, judgment sampling, quota sampling, 
and snowball sampling. They are convenient to use, but there are no statistical techniques with 
which to measure their random sampling error. 


5. Summarize the advantages and disadvantages of the various types of probability 
samples. Probability samples are based on chance selection procedures. These include simple 
random sampling, systematic sampling, stratified sampling, and cluster sampling. With these tech- 
niques, random sampling error can be accurately predicted. 


6. Discuss how to choose an appropriate sample design, as well as challenges for Internet 
sampling. A researcher who must determine the most appropriate sampling design for a 
specific project will identify a number of sampling criteria and evaluate the relative impor- 
tance of each criterion before selecting a design. The most common criteria concern accu- 
racy requirements, available resources, time constraints, knowledge availability, and analytical 
requirements. Internet sampling presents some unique issues. Researchers must be aware 
that samples may be unrepresentative because not everyone has a computer or access to the 
Internet. Convenience samples drawn from Web site visitors can create problems. Drawing 
a probability sample from an established consumer panel or an ad hoc sampling frame whose 
members opt in can be effective. 
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opt in 


To give permission to receive 
selected e-mail, such as question- 
naires, from a company with an 
Internet presence. 
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Key Terms and Concepts 


census, 387 

cluster sampling, 401 

convenience sampling, 396 
disproportional stratified sample, 400 
judgment (purposive) sampling, 396 
multistage area sampling, 402 
nonprobability sampling, 395 

opt in, 409 

population (universe), 387 


quota sampling, 397 


sample, 387 
sampling frame, 391 


reverse directory, 393 


population element, 387 
primary sampling unit (PSU), 393 
probability sampling, 395 
proportional stratified sample, 400 


random sampling error, 394 


Part 5: Sampling and Fieldwork 


sampling frame error, 393 
sampling unit, 393 

secondary sampling unit, 393 
simple random sampling, 398 
snowball sampling, 398 
stratified sampling, 400 
systematic sampling, 399 
tertiary sampling unit, 393 


Questions for Review and Critical Thinking 


il 


If you decide whether you want to see a new movie or televi- 
sion program on the basis of the “coming attractions” or televi- 
sion commercial previews, are you using a sampling technique? 
A scientific sampling technique? 

Name some possible sampling frames for the following: 
Electrical contractors 

Tennis players 

Dog owners 

Foreign-car owners 

Wig and hair goods retailers 


mono op 


Minority-owned businesses 

g. Men over six feet tall 

Describe the difference between a probability sample and a 

nonprobability sample. 

In what types of situations is conducting a census more appro- 

priate than sampling? When is sampling more appropriate than 

taking a census? 

Comment on the following sampling designs: 

a. A citizen’s group interested in generating public and finan- 
cial support for a new university basketball arena prints a 
questionnaire in area newspapers. Readers return the ques- 
tionnaires by mail. 

b. A department store that wishes to examine whether it is 
losing or gaining customers draws a sample from its list of 
credit card holders by selecting every tenth name. 

c. A motorcycle manufacturer decides to research consumer 
characteristics by sending one hundred questionnaires to 
each of its dealers. The dealers will then use their sales 
records to track down buyers of this brand of motorcycle 
and distribute the questionnaires. 

d. An advertising executive suggests that advertising effective- 
ness be tested in the real world. A one-page ad is placed in 
a magazine. One-half of the space is used for the ad itself. 
On the other half, a short questionnaire requests that read- 
ers comment on the ad. An incentive will be given for the 
first thousand responses. 

e. A research company obtains a sample for a focus group 
through organized groups such as church groups, clubs, and 
schools. The organizations are paid for securing respon- 
dents; no individual is directly compensated. 

f. A researcher suggests replacing a consumer diary panel with 

a sample of customers who regularly shop at a supermar- 

ket that uses optical scanning equipment. The burden of 

recording purchases by humans will be replaced by com- 
puterized longitudinal data. 


12; 


T3, 


14. 


g. A banner ad on a business-oriented Web site reads, “Are you 
a large company Sr. Executive? Qualified execs receive $50 for 
less than 10 minutes of time. Take the survey now!” Is this an 
appropriate way to select a sample of business executives? 

When would a researcher use a judgment, or purposive, sample? 

A telephone interviewer asks, “I would like to ask you about 

race. Are you Native American, Hispanic, African-American, 

Asian, or White?” After the respondent replies, the interviewer 

says, “We have conducted a large number of surveys with 

people of your background, and we do not need to question 
you further. Thank you for your cooperation.” What type of 
sampling is likely being used? 

If researchers know that consumers in various geographic 

regions respond quite differently to a product category, such as 

tomato sauce, is area sampling appropriate? Why or why not? 

What are the benefits of stratified sampling? 


. What geographic units within a metropolitan area are useful for 


sampling? 


. Researcher often are particularly interested in the subset of a 


market that contributes most to sales (for example, heavy beer 

drinkers or large-volume retailers). What type of sampling 

might be best to use with such a subset? Why? 

Outline the step-by-step procedure you would use to select the 

following: 

a. A simple random sample of 150 students at your university 

b. A quota sample of 50 light users and 50 heavy users of beer 
in a shopping mall intercept study 

c. A stratified sample of 50 mechanical engineers, 40 electrical 
engineers, and 40 civil engineers from the subscriber list of 
an engineering journal 

Selection for jury duty is supposed to be a totally random 

process. Comment on the following computer selection proce- 

dures, and determine if they are indeed random: 

a. A program instructs the computer to scan the list of names 
and pick names that were next to those from the last scan. 

b. Three-digit numbers are randomly generated to select 
jurors from a list of licensed drivers. If the weight informa- 
tion listed on the license matches the random number, the 
person is selected. 

c. The juror source list is obtained by merging a list of regis- 
tered voters with a list of licensed drivers. 

ETHICS To ensure a good session, a company selects focus group 

members from a list of articulate participants instead of con- 

ducting random sampling. The client did not inquire about 

sample selection when it accepted the proposal. Is this ethical? 


Chapter 16: Sampling Designs and Sampling Procedures 


Research Activities 


1. Phone directories are sometimes used for sampling frames. Go 
to www.reversephonedirectory.com and put in a phone number 
of someone you know in the reverse phone search (the num- 
ber must be a listed number to get results). Comment on the 
accuracy of the information and the appropriateness of phone 
directories as a representative sample. 

2. ‘NET Go to the U.S. Census Bureau’s home page at http://www. 
census.gov. Profiles of every state are available (you may find 
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the “Quick Facts” or “Population Finder” helpful) from this 
Web site. Find the data for Louisiana. Suppose a representative 
sample of the state of Louisiana is used to represent the current 
U.S. population. How well does Louisiana represent the United 
States overall? How well does Louisiana represent California or 
Maine? Use the profiles of the states and of the country to form 
your opinion. 


Case 16.1 Who’s Fishing? 


Washington Times columnist Gene Mueller writes 
about fishing and other outdoor sporting activi- 


Another idea would be to use state fishing license records. Privacy 
would be a drawback, however. Some people might not want their 


part of the country—no matter how large or how small. The infor- 
mation is updated several times per year and cross-checked against 
area code and assigned exchange lists furnished by telephone com- 
panies. Exchange and/or working blocks designated for business or 
governmental telephones, mobile phones, and other commercial 
services are screened out. 

STS can furnish almost any type of random-digit sample 
desired, including 


e National samples (continental United States only, or with Alaska 
and Hawaii) 

e Stratified national samples (by census region or division) 

e Census region or division samples 

e State samples 

e Samples by MSA 

e County samples 

e Samples by zip code 

e City samples by zip code 

e Exchange samples generated from lists of three-digit exchanges 

e Targeted random-digit dialing samples (including over 40 vari- 
ables and special databases for high-income areas, Hispanics, 
African-Americans, and Asians) 


>a ties.’ Mueller commented recently that although records shared, and they might withhold phone numbers. Further 
g 8 interest groups express concerns about the impact complicating this issue for Atlantic fishing is that most states in the 
ES of saltwater fishers on the fish population, no one Northeast do not require a license for saltwater fishing. Also exempt 
8 = really knows how many people fish for recreation in some states are people who fish from the shore and from piers. 
or how many fish they catch. This situation would challenge mar- A political action group called the Recreational Fishing 
keters interested in the population of anglers. Alliance suggests that charter fishing businesses collect data. 
How could a researcher get an accurate sample? One idea 
would be to contact residents of coastal counties using random- Questions 
digit dialing. This sampling frame would include many, if not all, of | 1. Imagine that an agency or business has asked for help in gather- 
the people who fish in the ocean, but it would also include many ing data about the number of sports anglers who fish off the coast 
people who do not fish—or who fish for business rather than recre- of Georgia. What advice would you give about sampling? What 
ation. A regional agency seeking to gather statistics on anglers, the method or combination of methods would generate the best results? 
Atlantic Coastal Cooperative Statistics Program, prefers to develop a 2. What other criteria besides accuracy would you expect to con- 
sampling frame more related to people who fish. sider? What sampling methods could help you meet those criteria? 
Case 16.2 Scientific Telephone Samples 
Scientific Telephone Samples (STS), located STS offers two different methods for pulling working blocks. 
N in Santa Ana, California, specializes in selling Either method can be used regardless of the geographic sampling 
>Hi sampling frames for marketing research.'* The unit (for example, state, county, zip). The two versions are Type A 
g ° STS sampling frame is based on a database of all (unweighted) and Type B (weighted/efficient). 
E 8 | working residential telephone exchanges in the Type A samples are pulled using a strict definition of random- 
Oe United States. Thus, STS can draw from any ness. They are called “unweighted” samples because each working 


block has an equal chance of being selected to generate a random- 
digit number. Completed interviews from a Type A sample that 
has been dialed to exhaustion should be highly representative of the 
population under study. 

Type B, or “efficient,” samples are preweighted, so random- 
digit dialing numbers are created from telephone working blocks in 
proportion to the number of estimated household listings in each 
working block. Working blocks that are more filled with numbers 
will be more prevalent in a sample. For example, a working block 
that had 50 known numbers in existence would have twice the 
probability of being included as one that had just 25 numbers. 

Type B samples are most useful when a researcher is willing to 
overlook a strict definition of randomness in favor of slightly more 
calling efficiency because of fewer “disconnects.” In theory, com- 
pleted interviews from Type B samples may tend to overrepresent 
certain types of working blocks, but many researchers feel there is 
not much difference in representativeness. 


Questions 

1. Evaluate the geographic options offered by STS. Do they seem 
to cover all the bases? 

2. Evaluate the STS method of random-digit dialing. 


CHAPTER 17 
DETERMINATION 
OF SAMPLE SIZE: 


STATI STI CA L TH EO RY After studying this chapter, you should be able to 
1. Understand basic statistical terminology 
2. Interpret frequency distributions, proportions, and mea- 
sures of central tendency and dispersion 


3. Distinguish among population, sample, and sampling 


distributions 
4. Explain the central-limit theorem 
5. Summarize the use of confidence interval estimates 


6. Discuss major issues in specifying sample size 


Chapter Vignette: Federal Reserve Finds Cards 
Are Replacing Cash 


Payment options have gone high-tech. Businesses that sell to consumers—and even chari- 

ties that seek donations from individuals—need to plan for a wide range of choices beyond 
traditional cash or checks. Today’s spenders are more likely to pay with a debit or credit card 

or through a variety of methods for electronic transfer of funds. To measure this trend in more 
detail, researchers at the Federal Reserve conducted surveys of depository institutions (banks, 
savings and loan institutions, and credit unions), asking them to report the number of each type 


of payment the institutions processed.’ 

In planning this survey, the Fed’s researchers carefully 
designed the sample, including the number of institutions 
to contact. The total number of depository institutions in 
the United States was already known: 14,117. The research- 
ers had to select enough institutions from this population 
to be confident that the answers would be representative 
of transactions nationwide. A stratified random sample was 
used so that each type of institution would be included. The 
researchers had conducted a similar survey three years earlier 
and obtained a 54 percent response rate, so they assumed the 
rate would be similar. Using techniques such as those described 
in this chapter, the researchers determined that, given the total 
number of institutions and the response rate, they would need 
to sample 2,700 depository institutions to obtain results that they 
could say, with 95 percent confidence, were accurate to within 
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+5 percent. 
With a response rate just above that of the prior survey, 1,500 


institutions responded, giving data on the number of transactions processed in each payment 
category. Their responses confirmed earlier analysis showing that the number of checks paid in 
the United States is declining while the number of electronic payments is increasing. Because 
this survey measured institutional transactions, it could not count the number of purchases 


made with cash. 

Formally identifying the proper sample size requires applied statistical theory. We under- 
stand that the word statistics often inspires dread among students. However, when a would-be 
researcher learns a few tricks of the trade, using statistics can become second nature. Many 
of these “tricks” involve simply learning the specialized language of statisticians. If you do not 

understand the basics of the language, you will have problems in conversation. Statistics is the 
language of the researcher. This chapter reviews some of the basic terminology of statistical 
analysis and applies statistical principles to the process of determining a sample size. 
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Chapter 17: Determination of Sample Size: A Review of Statistical Theory 


Introduction 


The first six sections of this chapter summarize key statistical concepts necessary for understanding 
the theory that underlies the calculation of sample size. These sections are intended for students 
who need to review the basic aspects of statistics theory. Even those students who received good 
grades in their elementary statistics classes probably will benefit from a quick review of the basic 
statistical concepts. Some students will prefer to just skim this material and proceed to page 432, 
where the discussion of the actual determination of sample size begins. Others need to study these 
sections carefully to acquire an understanding of statistics. 


Descriptive and Inferential Statistics 


The Statistical Abstract of the United States presents table after table of figures associated with numbers 
of births, number of employees in each county of the United States, and other data that the average 
person calls “statistics.” Technically, these are descriptive statistics, which describe basic characteristics 
and summarize the data in a straightforward and understandable manner. Another type of statistics, 
inferential statistics, is used to make inferences or to project from a sample to an entire population. 
For example, when a firm test-markets a new product in Peoria and Fort Worth, it is not only con- 
cerned about how customers in these two cities feel, but they want to make an inference from these 
sample markets to predict what will happen throughout the United States. So, two applications of 
statistics exist: (1) descriptive statistics which describe characteristics of the population or sample and 
(2) inferential statistics which are used to generalize from a sample to a population. 


Sample Statistics and Population Parameters 


A sample is a subset or relatively small portion of the total number of elements in a given popula- 
tion. Sample statistics are measures computed from sample data. Since business researchers typically 
deal with samples—we rarely talk to every consumer, manager, or organization—we normally base 
our decisions off of sample data. The primary purpose of inferential statistics is to make a judgment 
about a population, or the total collection of all elements about which a researcher seeks informa- 
tion, based from a subset of that population. 

Population parameters are measured characteristics of a specific population. In other words, 
information about the entire universe of interest. Sample statistics are used to make inferences 
(guesses) about population parameters based on sample data.? In our notation, we will generally 
represent population parameters with Greek lowercase letters—for example, u or a—and sample 
statistics with English letters, such as X or S. 


Making Data Usable 


Suppose a telephone survey has been conducted for a savings and loan association. The data have 
been recorded on a large number of questionnaires. To make the data usable, this information must 
be organized and summarized. Methods for doing this include frequency distributions, propor- 
tions, measures of central tendency, and measures of dispersion. 


Frequency Distributions 


One of the most common ways to summarize a set of data is to construct a frequency table, or frequency 
distribution. The process begins with recording the number of times a particular value of a variable 
occurs. This is the frequency of that value. Using an example of a telephone survey for a savings and 
loan association, Exhibit 17.1 on the next page represents a frequency distribution of respondents’ 
answers to a question that asked how much money customers had deposited in the institution. In this 
case, we can see that more respondents (811) checked the highest box of $12,000 or more. 

A similar method of describing the data is to construct a distribution of relative frequency, or a 
percentage distribution. To develop a frequency distribution of percentages, divide the frequency of 
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descriptive statistics 


Statistics which summarize and 
describe the data in a simple and 
understandable manner. 


inferential statistics 


Using statistics to project char- 
acteristics from a sample to an 
entire population. 


sample statistics 


Variables in a sample or measures 
computed from sample data. 


population parameters 


Variables in a population or 
measured characteristics of the 
population. 


frequency distribution 


A set of data organized by sum- 
marizing the number of times 

a particular value of a variable 
occurs. 


percentage distribution 


A frequency distribution orga- 
nized into a table (or graph) that 
summarizes percentage values 
associated with particular values 
of a variable. 


COURTESY OF QUALTRICS.COM 


This chapter covers basic statistical issues, with a focus on deter- 
mining sample size and level of precision. For example, how 
many people do we have to survey so we know our sample pro- 
portions are within 2 percent of the population proportions? Or 
what if we want to ensure our answers are within 0.50 point of 
the population’s mean on a seven-point scale? Similarly, how do 
we determine how precise our measures are after we have col- 
lected our data? After reading this chapter, you should be 
able to address these questions. 

Consider the question on our survey that asks if the 
respondent is employed? 


1. What percentage of respondents do you think will 
answer “yes” to this question? 

2. Based on your estimate, how many respondents would 
you need to be 95 percent confident your responses are 
+5 percent of the population proportion? 


3. Look at the data collected for your class. At 
the 95 percent confidence level, how precise 
is the measure regarding employment status? 


Consider the question that asks respondents 
to indicate how “interesting” or “boring” they feel 
their life is. 


4. Review the “rule of thumb” provided in the chapter regarding 
estimating the value of the standard deviation of a scale. 
Using this rule for the above scale, how many respondents 

would you need to be 95 percent confident your responses 

are £0.50 points of the population proportion? 

5. What if you want to be 99 percent confident? What 
would be the required sample size? 

6. Look at the data collected for your class. At the 95 per- 
cent confidence level, how precise is this measure? 


each value by the total number of observations, and multiply the result by 100. Based on the data 
in Exhibit 17.1, Exhibit 17.2 shows the percentage distribution of deposits; that is, the percentage 
of people holding deposits within each range of values. The highest percentage is in the top range, 
with 26% of all of the respondents. 


EXHIBIT 17.1 

Frequency Distribution 

of Deposits meant 
Under $3,000 
$3,000-$5,999 
$6,000-$8,999 
$9,000-$11,999 
$12,000 or more 

EXHIBIT 17.2 


Percentage Distribution 
of Deposits Amount 
Under $3,000 
$3,000-$5,999 
$6,000-$8,999 
$9,000-$11,999 


$12,000 or more 
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Frequency 


(Number of People Who Hold 
Deposits in Each Range) 


499 
530 
562 
718 
811 


3,120 


Percent 


(Percentage of People Who Hold 
Amount Deposits in Each Range) 


16% 
17% 
18% 
23% 
26% 


100% 


COURTESY OF 
QUALTRICS.COM 
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Probability is the long-run relative frequency with which an event will occur. Inferential statis- 
tics uses the concept of a probability distribution, which is conceptually the same as a percentage 
distribution except that the data are converted into probabilities. Exhibit 17.3 shows the prob- 
ability distribution of the savings and loan deposits. We know that the probability of a respondent 
falling into the top category of $12,000 or more is the highest, 0.26. 


Amount Probability 


Under $3,000 0.16 
$3,000-$5,999 0.17 
$6,000-$8,999 0.18 
$9,000-$11,999 0.23 
$12,000 or more 0.26 
1.00 

Proportions 


When a frequency distribution portrays only a single characteristic in terms of a percentage of 
the total, it defines the proportion of occurrence. A proportion, such as the proportion of CPAs at 
an accounting firm, indicates the percentage of population elements that successfully meet some 
standard concerning the particular characteristic. A proportion may be expressed as a percentage 
(25%), a fraction (1/4), or a decimal value (0.25). 


Measures of Central Tendency 


On a typical day, a sales manager counts the number of sales calls each sales representative makes. 
She may want to inspect the data to find the average, center, or middle area, of the frequency dis- 
tribution. Central tendency can be measured in three ways—the mean, median, or mode—each 
of which has a different meaning. The Research Snapshot on the next page illustrates how these 
measures may differ, 


THE MEAN 


We all have been exposed to the average known as the mean. The mean is simply the arithmetic 
average, and it is perhaps the most common measure of central tendency. More likely than not, you 
already know how to calculate a mean. However, knowing how to distinguish among the symbols 
>, u, and X is helpful to understand statistics. 

To express the mean mathematically, we use the summation symbol, the capital Greek letter 
sigma (&).A typical use might look like this: 

2x 
i=1 


X, + Xt Xi, +X, + XH +X, 


which is a shorthand way to write the sum 


Below the & is the initial value of an index, usually, i, j, or k, and above it is the final value, in this 
case n, the number of observations. The shorthand expression says to replace i in the formula with 
the values from 1 to 8 and total the observations obtained. Without changing the basic formula, 
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probability 


The long-run relative frequency 
with which an event will occur. 


EXHIBIT 17.3 
Probability Distribution 
of Deposits 


proportion 


The percentage of elements that 
meet some criterion. 


mean 


A measure of central tendency; 
the arithmetic average. 
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The Well-Chosen Average 

When you read an announcement by a corporate executive or a 
business proprietor that the average pay of the people who work 
in his or her establishment is so much, the figure may mean some- 
thing or it may not. If the average is a median, you can learn some- 
thing significant from it: Half of the employees make more than 
that; half make less. But if it is a mean (and believe me, it may be, if 
its nature is unspecified), you may be getting nothing more reveal- 
ing than the average of one $450,000 income—the proprietor's— 
and the salaries of a crew of lower wage workers. “Average annual 
pay of $57,000” may conceal both the $20,000 salaries and the 
owner's profits taken in the form of a whopping salary. 


Number 
of People Title Salary 
1 Proprietor $450,000 
1 President 150,000 
2 Vice presidents 100,000 
1 Controller 57,000 + Mean (arithmetical average) 
3 Directors 50,000 
4 Managers 37,000 
1 Supervisor 30,000 - Median (the one in the 
middle; 12 above, 12 below) 
12 Workers 20,000 + Mode (occurs most frequently) 


Let's take a longer look 
at this scenario. This table 
shows how many people get 
how much. The boss might 
like to express the situation 


the initial and final index values may be replaced by other values to indicate different starting and 


stopping points. 


Suppose our sales manager supervises the eight salespeople listed in Exhibit 17.4. To express 
the sum of the salespeople’s calls in È notation, we just number the salespeople (this number 


as “average wage $57,000,’ using that decep- Ey 
tive mean. The mode, however, is more j 
revealing: The most common rate of payin £ 
this business is $20,000 a year. As usual, the 
median tells more about the situation than 


any other single figure. Half of the people get 
more than $30,000 and half get less. 

Imagine what would happen to your hometown’s average 
income if Ross Perot and Bill Gates moved into town! Or, perhaps 
your university had an NBA lottery pick or a first round NFL foot- 
ball player. Adding in their multimillion dollar first-year salaries 
would certainly raise the “mean starting salary” for students. 
However, the median and mode would likely not change at all 
with these “outliers” included. 

Do politicians use statistics to lie or do the statistics lie? 
Politicians sometimes try to play one class of people against 
another in trying to get elected. One political claim is that the 
“rich do not pay taxes” or the “rich do not pay their fair share of 
taxes.” If you are curious about this, some facts are available at 
http://www.taxfoundation.org OF http://www.irs.gov/pub/irs-soi/disindin. 
pdf. Do the top 1 percent of wage earners pay taxes? Do the top 5 
percent of wage earners pay taxes? 


Sources: Huff, Darrell and Irving Geis, How to Lie with Statistics (New York: 

W. W. Norton, 1954), 33; Jackson, Brooks and Kathleen H. Jamieson, “Finding 
Fact in Political Debate,’ American Behavioral Scientist 48 (October 1, 2004), 
233-247. 


becomes the index number) and associate subscripted variables with their numbers of calls: 


Index Salesperson Variable Number of Calls 
1 = Mike X, = 4 
2 = Patty X, = 3 
3 = Billie X, = 2 
4 = Bob X, = 5 
5 = John Xx, = 3) 
6 = Frank X = 3 
7 = Chuck X, = 1 
8 = Samantha X, = 5 
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EXHIBIT 17.4 
Salesperson Number of Sales Calls Number of Sales Calls per 


Day by Salesperson 


Mike 4 
Patty 3 
Billie 2 
Bob 5 
John 3 
Frank 3 
Chuck 1 
Samantha 5 
Total 26 


We then write an appropriate } formula and evaluate it: 


8 
DX AX +X AMAR +X +X AN + %, 
=4+3+2+5+3+3+1+5 
= 26 


This notation is the numerator in the formula for the arithmetic mean: 


Mean = 
n 


The sum > X; tells us to add all the Xs whose subscripts are between 1 and n inclusive, where n 


equals the number of observations. The formula shows that the mean number of sales calls in this 
example is 3.25. 

Researchers generally wish to know the population mean, u (lowercase Greek letter mu), 
which is calculated as follows: 


where 
N = number of all observations in the population 


Often we will not have the data to calculate the population mean, p, so we will calculate a sample 
mean, X (read “X bar”), with the following formula: 


n 


Dx 


i=1 
n 


X= 
where 
n = number of observations made in the sample 


In this introductory discussion of the summation sign (2), we have used very detailed notation 
that includes the subscript for the initial index value (i) and the final index value (n). However, 
from this point on, references to È will sometimes omit the subscript for the initial index value (i) 
and the final index value (n). 
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median 


A measure of central tendency 
that is the midpoint; the value 
below which half the values in a 
distribution fall. 


mode 


A measure of central tendency; 
the value that occurs most often. 


EXHIBIT 17. 

Sales Levels for Two 
Products with Identical 
Average Sales 
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THE MEDIAN 


The next measure of central tendency, the median, is the midpoint of the distribution, or the 50th 
percentile. In other words, the median is the value below which half the values in the sample fall, 
and above which half of the values fall. In the sales manager example, 3 is the median because half 
the observations are greater than 3 and half are less than 3. 


THE MODE 


In apparel, mode refers to the most popular fashion. In statistics the mode is the measure of central 
tendency that identifies the value that occurs most often. In our example of sales calls, Patty, John, 
and Frank each made three sales calls. The value 3 occurs most often, so 3 is the mode. The mode 
is determined by listing each possible value and noting the number of times each value occurs. 


Measures of Dispersion 


The mean, median, and mode summarize the central tendency of frequency distributions. Accu- 
rate analysis of data also requires knowing the tendency of observations to depart from the central 
tendency. What is the spread across the observations? Thus, another way to summarize the data 
is to calculate the dispersion of the data, or how the observations vary from the mean. Consider, 
for instance, the 12-month sales patterns of the two products shown in Exhibit 17.5. Both have a 
mean monthly sales volume of 200 units, as well as a median and mode of 200, but the dispersion 
of observations for product B is much greater than that for product A. There are several measures 


of dispersion. 
Units Units 
Product A Product B 
January 196 150 
February 198 160 
March 199 175 
April 200 181 
May 200 192 
June 200 200 
July 200 200 
August 201 202 
September 201 213 
October 201 224 
November 202 240 
December 202 261 
Average 200 200 
THE RANGE 


The simplest measure of dispersion is the range. It is the distance between the smallest and the 
largest values of a frequency distribution. In Exhibit 17.5, the range for product A is between 196 
units and 202 units (6 units), whereas for product B the range is between 150 units and 261 units 
(111 units). The range does not take into account all the observations; it merely tells us about the 
extreme values of the distribution. 
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Just as people may be fat or skinny, distributions may be fat or skinny. While we do not expect 
all observations to be exactly like the mean, in a skinny distribution they will lie a short distance 
from the mean. Product A is an example; the observations are close together and reasonably close to 
the mean. In a fat distribution, such as the one for Product B, they will be spread out. Exhibit 17.6 
illustrates this concept graphically with two frequency distributions on a seven-point scale that 
have identical modes, medians, and means but different degrees of dispersion. 
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The interquartile range is the range that encompasses the middle 50 percent of the 
observations—in other words, the range between the bottom quartile (lowest 25 percent) and the 
top quartile (highest 25 percent). 


WHY USE THE STANDARD DEVIATION? 


Statisticians have derived several quantitative indexes to reflect a distribution’s spread, or variability. 
The standard deviation is perhaps the most valuable index of spread, or dispersion. Students often 
have difficulty understanding it. Learning about the standard deviation will be easier if we first look 
at several other measures of dispersion that may be used. Each of these has certain limitations that 
the standard deviation does not. 

First is the deviation. Deviation is a method of calculating how far any observation is from the 
mean. To calculate a deviation from the mean, use the following formula: 


d =X —X 


For the value of 150 units for product B for the month of January, the deviation score is —50; 
that is, 150 — 200 = —50. If the deviation scores are large, we will have a fat distribution because 
the distribution exhibits a broad spread. 

Next is the average deviation. We compute the average deviation by calculating the deviation 
score of each observation value (that is, its difference from the mean), summing these scores, and 
then dividing by the sample size (n): 


ae 2(Xi — X) 
Average deviation = = 
While this measure of spread may seem initially interesting, it is never used. Positive deviation 
scores are canceled out by negative scores with this formula, leaving an average deviation value 
of zero no matter how wide the spread may be. Hence, the average deviation is a useless spread 
measure. 

One might correct for the disadvantage of the average deviation by computing the absolute 
values of the deviations, termed mean absolute deviation. In other words, we ignore all the positive 
and negative signs and use only the absolute value of each deviation. The formula for the mean 
absolute deviation is 
= |X; -X| 

n 


Mean absolute deviation = 


While this procedure eliminates the problem of always having a zero score for the deviation mea- 
sure, some technical mathematical problems make it less valuable than some other measures. 
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Low Dispersion versus High 
Dispersion 
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variance 


A measure of variability or 
dispersion. Its square root is the 
standard deviation. 


standard deviation 


A quantitative index of a distribu- 
tion's spread, or variability; the 
square root of the variance for a 
distribution. 


1IBIT 
Calculating a Standard 
Deviation: Number of Sales 
Calls per Day for Eight 
Salespeople 
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The mean squared deviation provides another method of eliminating the positive/negative sign 
problem. In this case, the deviation is squared, which eliminates the negative values. The mean 
squared deviation is calculated by the following formula: 

0 2AX TW XY 
Mean squared deviation = — 


This measure is quite useful for describing the sample variability. 


Variance 

However, we typically wish to make an inference about a population from a sample, and so the 
divisor n — 1 is used rather than n in most pragmatic marketing research problems.’ This new 
measure of spread, called variance, has the following formula: 


E(X, -XP 
Variance = S? = ( i ) 
n— 


Variance is a very good index of dispersion. The variance, S?, will equal zero if and only if each 
and every observation in the distribution is the same as the mean. The variance will grow larger as 
the observations tend to differ increasingly from one another and from the mean. 


Standard Deviation 

While the variance is frequently used in statistics, it has one major drawback.The variance reflects a 
unit of measurement that has been squared. For instance, if measures of sales in a territory are made 
in dollars, the mean number will be reflected in dollars, but the variance will be in squared dollars. 
Because of this, statisticians often take the square root of the variance. Using the square root of the 
variance for a distribution, called the standard deviation, eliminates the drawback of having the 
measure of dispersion in squared units rather than in the original measurement units. The formula 
for the standard deviation is 


X, - X} 


n= 1 


sy 


Exhibit 17.7 illustrates that the calculation of a standard deviation requires the researcher to 
first calculate the sample mean. In the example with eight salespeople’s sales calls (Exhibit 17.4), we 
calculated the sample mean as 3.25. Exhibit 17.7 illustrates how to calculate the standard deviation 
for these data. 


X (X-X) (X— X)? 
4 (4 — 3.25) = 75 5625 
3 ESTESO ae .0625 
2 (225583225) 2S5 1.5625 
5 5325S 175 3.0625 
3 (B'S 53:25) 25 .0625 
3) G= 325) S = 25 .0625 
il (ll 325S 225 5.0625 
2 (6 = 3.25) = 175 3.0625 
os 0 13.5000 


X = 3.25 


n=8 X 
Sye 
5 =4/2% = = = S 1.9286 = 1.3887 
Var = 


aThe summation of this column is not used in the calculation of the standard deviation. 
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At this point we can return to thinking about the original purpose for measures of dispersion. 
We want to summarize the data from survey research and other forms of business research. Indexes 
of central tendency, such as the mean, help us interpret the data. In addition, we wish to calculate a 
measure of variability that will give us a quantitative index of the dispersion of the distribution. We 
have looked at several measures of dispersion to arrive at two very adequate means of measuring 
dispersion: the variance and the standard deviation. The formula given is for the sample standard 
deviation, S. 

The formula for the population standard deviation, o, which is conceptually very similar, 
has not been given. Nevertheless, you should understand that o measures the dispersion in the 
population and S measures the dispersion in the sample. These concepts are crucial to understand- 
ing statistics. Remember, a business researcher must know the language of statistics to use it in 
a research project. If you do not understand the language at this point, your should review this 
material now. 


The Normal Distribution 


One of the most common probability distributions in statistics is the normal distribution, com- 
monly represented by the normal curve. This mathematical and theoretical distribution describes the 
expected distribution of sample means and many other chance occurrences. The normal curve is 
bell shaped, and almost all (99 percent) of its values are within +3 standard deviations from its mean. 
An example of a normal curve, the distribution of IQ scores, appears in Exhibit 17.8 on the next 
page. In this example, 1 standard deviation for IQ equals 15. We can identify the proportion of the 
curve by measuring a score’s distance (in this case, standard deviation) from the mean (100). 

The standardized normal distribution is a specific normal curve that has several characteristics: 


1. It is symmetrical about its mean; the tails on both sides are equal. 

2. The mode identifies the normal curve’s highest point, which is also the mean and median, and 
the vertical line about which this normal curve is symmetrical. 

3. The normal curve has an infinite number of cases (it is a continuous distribution), and the area 
under the curve has a probability density equal to 1.0. 

4. The standardized normal distribution has a mean of 0 and a standard deviation of 1. 


Exhibit 17.9 on the next page illustrates these properties. Exhibit 17.10 on the next page is 
a summary version of the typical standardized normal table found at the end of most statistics 
textbooks. A more complex table of 
areas under the standardized normal 
distribution appears in Table A.2 in 
the appendix. 

The standardized normal distribu- 
tion is a purely theoretical probability 
distribution, but it is the most useful 
distribution in inferential statistics. 
Statisticians have spent a great deal of 
time and effort making it convenient 
for researchers to find the probability 
of any portion of the area under the 
standardized normal distribution. All 
we have to do is transform, or con- 
vert, the data from other observed 
normal distributions to the standard- 
ized normal curve. In other words, 
the standardized normal distribution 
is extremely valuable because we 
can translate, or transform, any nor- 
mal variable, X, into the standardized 
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normal distribution 


Asymmetrical, bell-shaped 
distribution that describes the 
expected probability distribution 
of many chance occurrences. 


standardized normal 
distribution 


A purely theoretical probability 
distribution that reflects a specific 
normal curve for the standard- 
ized value, z. 


By recording the results of spins 

of the roulette wheel, one might 
find a pattern or distribution of 

the results. 
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EXHIBIT 17.8 

Normal Distribution: 
Distribution of Intelligence 
Quotient (IQ) Scores 


55 l 70 85 100 115 130 145 IQ 


EXHIBIT 17.9 
Standardized Normal 
Distribution 


EXHIBIT 17.10 Standardized Normal Table: Area under Half of the Normal Curve? 


Z 
Standard Z Standard Deviations from the Mean (Tenths of Units) 
Deviations from the 
Mean (Units) 3 4 5 6 7 
0.0 .000 .040 .080 118 2155 .192 226 258 .288 B5 
1.0 341 364 -385 .403 .419 433 A445 A455 464 A71 
2.0 77 482 486 489 A492 A494 A95 A496 A97 A498 
3.0 499 499 499 499 A499 A499 A99 A499 A499 A499 


*Area under the segment of the normal curve extending (in one direction) from the mean to the point indicated by each row-column combination. For example, 
about 68 percent of normally distributed events can be expected to fall within 1.0 standard deviation on either side of the mean (0.341 X 2). An interval of almost 
2.0 standard deviations around the mean will include 95 percent of all cases. 


value, Z. Exhibit 17.11 illustrates how either a skinny distribution or a fat distribution can be 
converted into the standardized normal distribution. This ability to transform normal variables has 
many pragmatic implications for the business researcher. The standardized normal table in the back 
of most statistics and research books allows us to evaluate the probability of the occurrence of many 
events without any difficulty. 
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Either, 

A flat distribution 

or, 

A peaked distribution, 

can be converted into a 
Standard normal distribution 
through standardization. 


-lo +10 


Computing the standardized value, Z, of any measurement expressed in original units is simple: 
Subtract the mean from the value to be transformed, and divide by the standard deviation (all 
expressed in original units). The formula for this procedure and its verbal statement follow. In the 
formula, note that o, the population standard deviation, is used for calculation.* Also note that we 
do not use an absolute value, but rather allow the Z value to be either negative (below the mean) 
or positive (above the mean). 


Value to be transformed — Mean 
Standard deviation 


Standardized value = 


where 
u = hypothesized or expected value of the mean 


Suppose that in the past a toy manufacturer has experienced mean sales, u, of 9,000 units 
and a standard deviation, ø, of 500 units during September. The production manager wishes to 
know whether wholesalers will demand between 7,500 and 9,625 units during September of the 
upcoming year. Because no tables are available showing the distribution for a mean of 9,000 and a 
standard deviation of 500, we must transform our distribution of toy sales, X, into the standardized 
form using our simple formula: 


X— pm 7,500 — 9,000 
o 7 500 


Z= = —3.00 


X—p 9,625 — 9,000 
o 7 500 


The —3.00 indicates the standardized Z for sales of 7,500, while the 1.25 is the Z score for 9,625. 
Using Exhibit 17.10 (or Table A.2 in the appendix), we find that 


Z= = 1.25 


423 


EXHIBIT 17.11 

Standardized Values Can 
Be Computed from Flat 

or Peaked Distributions 
Resulting in a Standardized 
Normal Curve 
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When Z = —3.00, the area under the curve (probability) equals 0.499. 
When Z = 1.25, the area under the curve (probability) equals 0.394. 


Thus, the total area under the curve is 0.499 + 0.394 = 0.893. In other words, the probability (Pr) 
of obtaining sales in this range is equal to 0.893. This is illustrated in Exhibit 17.12 in the shaded 
area. The sales manager, therefore, knows there is a 0.893 probability that sales will be between 
7,500 and 9,625. We can go a step further here by comparing the area under the curve to the total. 
Since the distribution is symmetrical, 0.500 of the distribution is on either side of the center line. 
For the 7,500 figure the area under our curve is 0.499, so the probability of sales being less than 
7,500 is 0.001 (0.500 — 0.499). Similarly, the probability of sales being more than 9,625 is 0.106 
(0.500 — 0.394). 


EXHIBIT 17.12 
Standardized Distribution Pr(Z) 
Curve 
A= 
B= Shaded Area = 0.499 Shaded Area = 0.394 


TO POINT At this point, it is appropriate to repeat that understanding statistics requires an understand- 
ing of the language that statisticians use. Each concept discussed so far is relatively simple, but 
Order is heaven” law, a clear-cut command of this terminology is essential for understanding what we will discuss 


l : 
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Population Distribution, Sample 
Distribution, and Sampling Distribution 


Before we outline the technique of statistical inference, three additional types of distributions must 
be defined: population distribution, sample distribution, and sampling distribution. When conduct- 
ing a research project or survey, the researcher’s purpose is typically not to describe only the sample 
of respondents, but to make an inference about the population. As defined previously, a population, 
or universe, is the total set, or collection, of potential units for observation. The sample is a smaller 
subset of this population. 
population distribution A frequency distribution of the population elements is called a population distribution. The 
A frequency distribution of the mean and standard deviation of the population distribution are represented by the Greek letters 
elements of a population. yw and oa. A frequency distribution of a sample is called a sample distribution. The sample mean is 
designated X, and the sample standard deviation is designated S. 
The concepts of population distribution and sample distribution are relatively simple. How- 


sample distribution 


A frequency distribution of a 


Simple ever, we must now introduce another distribution, which is the crux of understanding statistics: 


the sampling distribution of the sample mean. The sampling distribution is a theoretical probability 
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distribution that in actual practice would never be calculated. Hence, practical, business-oriented 
students have difficulty understanding why the notion of the sampling distribution is important. 
Statisticians, with their mathematical curiosity, have asked themselves, “What would happen if we 
were to draw a large number of samples (say, 50,000), each having n elements, from a specified 
population?” Assuming that the samples were randomly selected, the sample means, Xs, could be 
arranged in a frequency distribution. Because different people or sample units would be selected 
in the different samples, the sample means would not be exactly equal. The shape of the sampling 
distribution is of considerable importance to statisticians. If the sample size is sufficiently large and 
if the samples are randomly drawn, we know from the central-limit theorem (discussed below) that 
the sampling distribution of the mean will be approximately normally distributed. 
A formal definition of the sampling distribution is as follows: 


A sampling distribution is a theoretical probability distribution that shows the functional relation between 
the possible values of some summary characteristic of n cases drawn at random and the probability (density) 
associated with each value over all possible samples of size n from a particular population.” 


The sampling distribution’s mean is called the expected value of the statistic. The expected value 
of the mean of the sampling distribution is equal to u. The standard deviation of a sampling distri- 
bution of X is called standard error of the mean (Sx) and is approximately equal to 


oC 


x AVY 


To review, for us to make an inference about a population from a sample, we must know about 


three important distributions: the population distribution, the sample distribution, and the sam- 
pling distribution. They have the following characteristics: 


Mean Standard Deviation 


Population distribution H o 
Sample distribution X S 
Sampling distribution jl H Sx 


We now have much of the information we need to understand the concept of statistical infer- 
ence. To clarify why the sampling distribution has the characteristic just described, we will elabo- 
rate on two concepts: the standard error of the mean and the central-limit theorem. You may be 
wondering why the standard error of the mean, Sx, is defined as Sy = 0/\/7.The reason is based 
on the notion that the variance or dispersion within the sampling distribution of the mean will be 
less if we have a larger sample size for independent samples. It should make intuitive sense that a 
larger sample size allows the researcher to be more confident that the sample mean is closer to the 
population mean. In actual practice, the standard error of the mean is estimated using the sample’s 
standard deviation. Thus, Sx is estimated using S/~/7. 

Exhibit 17.13 on the next page shows the relationship among a population distribution, the 
sample distribution, and three sampling distributions for varying sample sizes. In part (a) the popu- 
lation distribution is not a normal distribution. In part (b) the first sample distribution resembles 
the distribution of the population; however, there may be other distributions as shown in the sec- 
ond and third sample distributions. In part (c) each sampling distribution is normally distributed 
and has the same mean. However, as sample size increases, the spread of the sample means around 
p decreases. Thus, with a larger sample size we will have a more narrow sampling distribution. 


Central-Limit Theorem 


Finding that the means of random samples of a sufficiently large size will be approximately normal 
in form and that the mean of the sampling distribution will approach the population mean is very 
useful. Mathematically, this is the assertion of the central-limit theorem, which states, as the sample 
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sampling distribution 


A theoretical probability 
distribution of sample means for 
all possible samples of a certain 
size drawn from a particular 
population. 


standard error of the 
mean 


The standard deviation of the 
sampling distribution. 


central-limit theorem 


The theory that, as sample size 
increases, the distribution of sam- 
ple means of size n, randomly 
selected, approaches a normal 
distribution. 
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EXHIBIT 17.13 


Fundamental Types of a 
Distributions : p = Mean of the population 
Terre n o = Standard deviation of the 
population 
X = Values of items in the 
population 
Provides u x 
Data for 
_(b) i | 
Possible Sample | 
Distributions 
K X X X KEX 
X = Mean of a sample distribution 
Provide S = Standard deviation of a sample distribution 
Data for X = Values of items in a sample 
Samples of size > n, e.g., 2,500 jz = Mean of the sampling 
distribution of means 
A Samples of size n, e.g., 500 Sz = Standard deviation of 
(c) the sampling distribution 
The Sampling Samples of size < n, e.g., 100 of means 
Distribution of = : 
the Sample X = Values of all possible 
Means sample means 


Source: Adapted from Sanders, D. H., A. F. Murphy, and R. J. Eng, Statistics: A Fresh Approach (New York: McGraw-Hill, 1980), 123. 


size, n, increases, the distribution of the mean, X, of a random sample taken from practically any 
population approaches a normal distribution (with a mean u and a standard deviation o/ vn ).® 
The central-limit theorem works regardless of the shape of the original population distribution 
(see Exhibit 17.14). 

A simple example will demonstrate the central-limit theorem. Assume that a quality control 
specialist is examining the number of defects in the products produced by assembly line work- 
ers. Assume further that the population the researcher is investigating consists of six different 
workers in the same plant. Thus, in this example, the population consists of only six individu- 
als. Exhibit 17.15 shows the population distribution of defects in a week. Donna, a dedicated 
and experienced worker, only has one defect in the entire week’s production. On the other 
hand, Eddie, a sloppy worker with little regard for quality, has six defects a week. The average 
number of defects each week is 3.5, so the population mean, m, equals 3.5 (see Exhibit 17.16 
on page 428). 

Now assume that we do not know everything about the population, and we wish to take a 
sample with two observations, to be drawn randomly from the population of the six individuals. 
How many possible samples are there? The answer is 15, as follows: 


1,2 
13 2,3 

1,4 2,4 3,4 

1,5 2,5 3,5 4,5 

1,6 2,6 3,6 4,6 5,6 


Population 


Values of X 


Sampling B 
distribution of X 


Population 


Values of X 


Sampling £ 
distribution of X 
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Population 


Values of X 


Sampling B 
distribution of X 


Population 


P SN 


Values of X 


Sampling _ 
distribution of X 


Values of X 


Sampling E 
distribution of X 


Values of X 


Sampling a 
distribution of X 


Values of X 


Sampling B 
distribution of X 


Values of X 


Sampling br 
distribution of X 


Nes 
= 
|_| | 
Values of X Values of X Values of X Values of X 
Sampling z Sampling Sampling Sampling 


distribution of X 


distribution of X 


distribution of X 
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Distribution of Sample 
Means for Samples 

of Various Sizes and 
Population Distributions 


distribution of X 


n=30 
n=30 
n=30 
n=30 
| | | | | | | ME | 


Values of X Values of X Values of X Values of X 


Source: Kurnow, Ernest, Gerald J. Glasser, and Frederick R. Ottman, Statistics for Business Decisions (Homewood, IL: Richard D. 
Irwin, 1959), 182-183. 


EXHIBIT 17.15 
Employee Defects Population Distribution: 
Hypothetical Product Defect 


Donna 1 

Heidi 2 
Jason 3 
Jennifer 4 
Mark 5 
Eddie 6 


Exhibit 17.17 on the next page lists the sample mean for each of the possible 15 samples and 
the frequency distribution of these sample means with their appropriate probabilities. These sample 
means comprise a sampling distribution of the mean, and the distribution is approximately normal. 
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EXHIBIT 17.16 
Calculation of Population 
Mean 


EXHIBIT 17.17 
Arithmetic Means of 
Samples and Frequency 
Distribution of Sample 
Means 
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Calculations: u = =" = — = 3.5 = py, 


Sample Means 
Probability 
1,2 3.00 1.50 1/15 
13 4.00 2.00 1/15 
1,4 5.00 250 1/15 
5 6.00 3.00 1/15 
1,6 7.00 3.50 1/15 
23 5.00 2.50 1/15 
2,4 6.00 3.00 1/15 
2795 7.00 3.50 1/15 
2,6 8.00 4.00 1/15 
3,4 7.00 3.50 1/15 
379 8.00 4.00 1/15 
3,6 9.00 4.50 1/15 
4,5 9.00 4.50 1/15 
4,6 10.00 5.00 1/15 
5,6 11.00 5.50 1/15 


Frequency Distribution 


Sample Mean Frequency Probability 


1.50 1 1/15 
2.00 1 1/15 
2.50 2 2/15 
3.00 2 2/15 
3.50 3 3/15 
4.00 2 2/15 
4.50 2 2/15 
5.00 1 1/15 


5.50 1 1/15 
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If we increased the sample size to three, four, or more, the distribution of sample means would 
more closely approximate a normal distribution. While this simple example is not a proof of the 
central-limit theorem, it should give you a better understanding of the nature of the sampling 
distribution of the mean. 

This theoretical knowledge about distributions can be used to solve two practical business 
research problems: estimating parameters and determining sample size. 


Estimation of Parameters 


A catalog retailer, such as dELiA*s, may rely on sampling and statistical estimation to prepare for 
Christmas orders. The company can expect that 28 days after mailing a catalog, it will have received 
X percent of the orders it will get. With this information, the company can tell within 5 percent 
how many pairs of Harlow Low-Ruise Super Skinny Jeans they will sell by Christmas. Making a 
proper inference about population parameters is highly practical for a business that must have the 
inventory appropriate for a particular selling season. 

Suppose you are a product manager for ConAgra Foods and you recently conducted a taste test 
to measure intention to buy a reformulated Swiss Miss Lite Cocoa Mix.The results of the research 
indicate that when the product was placed in eight hundred homes and a callback was made two 
weeks later, 80 percent of the respondents said they would buy it: 76 percent of those who had not 
previously used low-calorie cocoa and 84 percent of those who had. How can you be sure there 
were no statistical errors in this estimate? How confident can you be that these figures accurately 
reflect the true attitudes? 

Students often wonder whether statistics are really used in the business world. The answer is 
yes. The two situations just described provide examples of the need for statistical estimation of 
parameters and the value of statistical techniques as managerial tools. 


Point Estimates 


Our goal in using statistics is to make an estimate about population parameters.A population mean, 
pb, and standard deviation, ø, are constants, but in most instances of business research, they are 
unknown. To estimate population values, we are required to sample. As we have discussed, X and 
S are random variables that will vary from sample to sample with a certain probability (sampling) 
distribution. 

Our previous example of statistical inference was somewhat unrealistic because the population 
had only six individuals. Consider the more realistic example of a prospective racquetball entrepre- 
neur who wishes to estimate the average number of days players participate in this sport each week. 
When statistical inference is needed, the population mean, m, is a constant but unknown parameter. 
To estimate the average number of playing days, we could take a sample of three hundred racquet- 
ball players throughout the area where our entrepreneur is thinking of building club facilities. If the 
sample mean, X, equals 2.6 days per week, we might use this figure as a point estimate. This single 
value, 2.6, would be the best estimate of the population mean. However, we would be extremely 
lucky if the sample estimate were exactly the same as the population value. A less risky alternative 
would be to calculate a confidence interval. An example of a point estimate and confidence interval 
is provided in the Research Snapshot on the next page. 


Confidence Intervals 


If we specify a range of numbers, or interval, within which the population mean should lie, we 
can be more confident that our inference is correct. A confidence interval estimate is based on 
the knowledge that u = X + a small sampling error. After calculating an interval estimate, we 
can determine how probable it is that the population mean will fall within this range of statistical 
values. In the racquetball project, the researcher, after setting up a confidence interval, would be 
able to make a statement such as “With 95 percent confidence, I think that the average number 
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point estimate 


An estimate of the population 
mean in the form of a single 
value, usually the sample mean. 


confidence interval 
estimate 


A specified range of numbers 
within which a population mean 
is expected to lie; an estimate 

of the population mean based 
on the knowledge that it will be 
equal to the sample mean plus 
or minus a small sampling error. 
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Accuracy of Political Polls 
Over 20 organizations conduct national political polls. For the 
candidates, these polls are great sources of information. Results 
of these polls can illustrate trends, identify messages to use in 
their promotional efforts, and target areas for special campaign 
emphasis. While many surveys are used in the business world 

to predict outcomes, we often have difficulty determining how 
accurate the surveys were. Political polls are quite different, as we 
get specific results and can analyze how accurate the polls were 
after the fact. 

Zogby International (http://www.zogby.com) is one of these poll- 
ing organizations. Zogby International is an independent and 
nonpartisan polling organization that conducts political polls in 

the United States, as well as far 


In the 2008 U.S. Presidential election, 
Zogby's final poll consisted of 1,205 likely 
voters. This poll indicated that 50.9 percent 
of voters would vote for Barak Obama and 
43.8 percent for John McCain. According to 
the researchers, the confidence level was 95 per- 
cent that the sampling error was not greater than +3 percentage 
points. So, Zogby was 95 percent sure that Obama would receive 
between 53.9 percent and 47.9 percent of the overall vote, while 
McCain would receive between 46.8 percent and 40.8 percent. 
The final vote tally totals show that out of over 125 million 
votes cast, Barak Obama received 53 percent of the popular vote 
while John McCain received 46 percent. Indeed, Zogby was quite 
accurate in their ability to predict the overall vote from a sample 


confidence level 


A percentage or decimal value 
that tells how confident a 
researcher can be about being 
correct; it states the long-run per- 
centage of confidence intervals 
that will include the true 
population mean. 
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reaching parts of the world, that represented less than 0.001% of the vote. 
including the Middle East, 
Latin America, and the 2009 
Albanian elections. Zogby has 
a reputation as a highly accu- 


rate polling organization. 


Sources: Based on “Final Presidential Polls,’ The Huffington Post November 2, 2008, 
http://www.huffingtonpost.com/2008/1 1/02/latest-presidential-polls_n_140177. 
html; “Reuters/C-SPAN/Zogby Poll: Final: Obama in Double-Digit Lead, 54% to 
43%,’ Zoby International, http://www.zogby.com/search/ReadNews.cfm?ID=1633, 
accessed March 18, 2009. 


of days played per week is between 2.3 and 2.9.’ This information can be used to estimate market 
demand because the researcher has a certain confidence that the interval contains the value of the 
true population mean. 

The crux of the problem for a researcher is to determine how much random sampling error to 
tolerate. In other words, what should the confidence interval be? How much of a gamble should be 
taken that u will be included in the range? Do we need to be 80 percent, 90 percent, 95 percent, or 
99 percent sure? The confidence level is a percentage or decimal that indicates the long-run prob- 
ability that the results will be correct. Traditionally, researchers have used the 95 percent confidence 
level. While there is nothing magical about the 95 percent confidence level, it is useful to select this 
confidence level in our examples. 

As mentioned, the point estimate gives no information about the possible magnitude of random 
sampling error. The confidence interval gives the estimated value of the population parameter, plus 
or minus an estimate of the error. We can express the idea of the confidence interval as follows: 


ju = X £ a small sampling error 


More formally, assuming that the researchers select a large sample (more than 30 observations), the 
small sampling error is given by 


Small sampling error = Z, Sx 


where 


Z.. = value of Z, or standardized normal variable, at a specified confidence level (c./.) 


z = standard error of the mean 


The precision of our estimate is indicated by the value of Z., Sx. It is useful to define the range 
of possible error, E, as follows: 


ES Za Sx 
Thus, 
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where 


X = sample mean 


E = range of sampling error 


or 


w=X+ ZS 


The confidence interval +E is always stated as one-half (thus the plus or minus) of the total con- 
fidence interval. 
The following step-by-step procedure can be used to calculate confidence intervals: 


1. Calculate X from the sample. 
Assuming © is unknown, estimate the population standard deviation by finding S, the sample 
standard deviation. 

3. Estimate the standard error of the mean, using the following formula: 


4. Determine the Z-value associated with the desired confidence level. The confidence level 
should be divided by 2 to determine what percentage of the area under the curve to include 
on each side of the mean. 

5. Calculate the confidence interval. 


The following shows how a confidence interval can be calculated. Suppose you are a financial 
planner and are interested in knowing how long investors tend to own individual stocks. In a sur- 
vey of 100 investors, you find that the mean length of time a stock is held is (X) is 37.5 months, 
with a standard deviation (S) of 12.0 months. Even though 37.5 months is the “expected value” 
and the best guess for the true mean in the population (u), the likelihood is that the mean is not 
exactly 37.5. Thus, a confidence interval around the sample mean computed using the steps just 
given will be useful: 


1. X= 37.5 months 
2. S= 12.0 months 


3 

4. Suppose you wish to be 95 percent confident—that is, assured that 95 times out of 100, the 
estimates from your sample will include the population parameter. Including 95 percent of 
the area requires that 47.5 percent (one-half of 95 percent) of the distribution on each side be 
included. From the Z-table (Table A.2 in the appendix), you find that 0.475 corresponds to the 
Z-value 1.96. 

5. Substitute the values for Z., and Sx into the confidence interval formula: 


u = 37.5 + (1.96)(1.2) 
= 37.5 + 2.352 


You can thus expect that w is contained in the range from 35.148 to 39.852 months. Intervals 
constructed in this manner will contain the true value of u 95 percent of the time. 
Step 3 can be eliminated by entering S and n directly in the confidence interval formula: 


= 5 
H5 XE Za n 


Remember that S/\/7 represents the standard error of the mean. Its use is based on the central- 
limit theorem. 

If you wanted to increase the probability that the population mean will lie within the con- 
fidence interval, you could use the 99 percent confidence level, with a Z-value of 2.57. You may 
want to calculate the 99 percent confidence interval for the preceding example; you can expect 
that u will be in the range between 34.416 and 40.584 months. It should make intuitive sense that 
if we are 99 percent confident that the spread will be larger than if we are only 95 percent confi- 
dent. If we want to be more confident, we need a broader range. 
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Relationship between 
Sample Size and Error 


Part 5: Sampling and Fieldwork 


We have now examined the basic concepts of inferential statistics. You should understand that 
sample statistics such as the sample means, Xs, can provide good estimates of population param- 
eters such as u. You should also realize that there is a certain probability of being in error when 
you estimate a population parameter from sample statistics. In other words, there will be a random 
sampling error, which is the difference between the results of a survey of a sample and the results 
of surveying the entire population. If you have a firm understanding of these basic terms and ideas, 
which are the essence of statistics, the remaining statistics concepts will be relatively simple for you. 
Several ramifications of the simple ideas presented so far will permit you to make better decisions 
about populations based on surveys or experiments. 


Sample Size 


Random Error and Sample Size 


When asked to evaluate a business research project, most people, even those with little research 
training, begin by asking, “How big was the sample?” Intuitively we know that the larger the 
sample, the more accurate the research. This is in fact a statistical truth; random sampling error 
varies with samples of different sizes. In statistical terms, increasing the sample size decreases the 
width of the confidence interval at a given confidence level. Obviously if we collect information 
from every member of the population, we know the population parameters, so there would be 
no interval. When the standard deviation of the population is unknown, a confidence interval is 
calculated using the following formula: 

oS 

Vn 


Observe that the equation for the plus or minus error factor in the confidence interval includes 


Confidence interval = X + Z 


n, the sample size: 
S 
E= L 
If n increases, E is reduced. Exhibit 17.18 illustrates that the confidence interval (or magnitude of 
error) decreases as the sample size, n, increases. 

We already noted that it is not necessary to take a census of all elements of the population to 
conduct an accurate study. The laws of probability give investigators sufficient confidence regard- 
ing the accuracy of data collected from a sample. Knowledge of the characteristics of the sampling 
distribution helps researchers make reasonably precise estimates. 


Large 
S 
i 
D 
= is 
oS 
N 
= 
Oo 
1S) 
i= 
© 
a 
Small = 
Small Large 


Size of Sample (n) 


Source: From Foundations of Behavioral Research, 3rd edition, by Fred N. Kerlinger. © 1986. Reprinted with permission of 
Wadsworth, a division of Cengage Learning, http://www.cengage.com/permissions/. Fax 800-730-2215. 
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COURTESY, SCARBOROUGH 


4 Target and Wal-Mart Shoppers 
= ~ Really Are Different 
Scarborough Research conducts ongo- 
ing consumer research that combines a telephone 
interview on media behavior with a mail survey 
about shopping habits and lifestyle and a television diary for 
detailed data about television viewing. Scarborough recognizes 
the importance of sample size for minimizing errors. Its sample 
includes over 200,000 adults so that it can make estimates of the 
U.S. population. 
An example is a recent comparison of consumers who 
shop exclusively at either Target or Wal-Mart. When respon- 
dents were asked to identify the stores at which they had 
shopped during the preceding three months, the largest share 


Sot E 


rT nl x AD a 


(40 percent) named both Target and Wal-Mart. However, 
31 percent shopped at Wal-Mart but not Target, and 12 percent 
shopped at Target but not Wal-Mart. Scarborough compared the 
consumer behavior of the latter two groups. 

Target shoppers who shunned Wal-Mart were more likely to 
shop at more upscale stores, including Macy’s and Nordstrom. 
They also were more likely than the average shopper to visit many 
different stores. Wal-Mart shoppers who stayed away from Target 
were more likely to shop at discounters such as Dollar General and 
Kmart, and they were more likely to be at least 50 years old. Target- 
only shoppers tended to be younger and were more likely to have a 
high household income. 

Given a U.S. adult population of approximately 220 million, do 
you think the sample size was adequate to make these comparisons? 
Source: Based on “In the Battle for Discount Shoppers, Target and Wal-Mart 


Find Brand Loyalty in Different Customer Groups,’ Scarborough Research 
news release (September 19, 2005), http://www.scarborough.com; “About 


te @ret~ Scarborough: Methodology,’ Scarborough Research, http://www.scarbor- 


BH iG @¢8F Pr eem- dal 


ough.com, accessed 
March 16, 2006; 


U.S. Census Bureau, 
Statistical Abstract of 
the United States (2006), 
table 11, p. 13. 


Our two-phase methodology results in a multi-step relationship E i N 
with the respondent, designed to achieve maximum cooperation 1. Telephone interview (16 minutes). 
Up to 14 attempts are made to reach a designated respondent. ©. Postcard or letter ie railed if respondent rehmer tes participate 
explaining purpose and providing toll:free:rumber and welsite 
Phase | - A RANDOMLY DIALED TELEPHONE INTERVIEW foo nore annin 
Radio listening, newspaper reading, some television viewing, 3. Survey Booklet & Television Diy ae mailed with each incentive 
Internet websites visited and demographics are captured if i 7 ioe eal 
one @ Unicow zone 


Increasing the sample size reduces the sampling error. However, those familiar with the law of 
diminishing returns in economics will easily grasp the concept that increases in sample size reduce 
sampling error at a decreasing rate. For example, doubling a sample of 1,000 will reduce random 
sampling error by 1 percentage point, but doubling the sample from 2,000 to 4,000 will reduce 
random sampling error by only another half percentage point. More technically, random sampling 
error is inversely proportional to the square root of n. (Exhibit 17.18 gives an approximation of 
the relationship between sample size and error.) Thus, the main issue becomes one of determining 
the optimal sample size. The Research Snapshot above discusses sample size and shows that some 
samples are extremely large. 


Factors in Determining Sample Size 
for Questions Involving Means 


Three factors are required to specify sample size: (1) the heterogeneity (i.e., variance) of the popu- 
lation; (2) the magnitude of acceptable error (i.e., = some amount); and (3) the confidence level 
(i.e., 90 percent, 95 percent, 99 percent). 

The determination of sample size heavily depends on the variability within the sample. The 
variance, or heterogeneity, of the population is the first necessary bit of information. In statistical 
terms, this refers to the standard deviation of the population. Only a small sample is required if the 
population is homogeneous. For example, predicting the average age of college students requires 
a smaller sample than predicting the average age of people who visit the zoo on a given Sun- 
day afternoon. As heterogeneity increases, so must sample size. Thus, to test the effectiveness of an 
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EXHIBIT 17.19 
Statistical Information 
Needed to Determine 
Sample Size for Questions 


Involving Means 


Part 5: Sampling and Fieldwork 


employee training program, the sample must be large enough to cover the range of employee work 
experience (for example). 

The magnitude of error, or the confidence interval, is the second necessary bit of information. 
Defined in statistical terms as E, the magnitude of error indicates how precise the estimate must 
be. It indicates a certain precision level. From a managerial perspective, the importance of the deci- 
sion in terms of profitability will influence the researcher’s specifications of the range of error. If, 
for example, favorable results from a test-market sample will result in the construction of a new 
plant and unfavorable results will dictate not marketing the product, the acceptable range of error 
probably will be small; the cost of an error would be too great to allow much room for random 
sampling errors. In other cases, the estimate need not be extremely precise. Allowing an error of 
+$1,000 in total family income instead of E = £50 may be acceptable in most market segmenta- 
tion studies. 

The third factor of concern is the confidence level. In our examples, as in most business research, 
we will typically use the 95 percent confidence level. This, however, is an arbitrary decision based 
on convention; there is nothing sacred about the 0.05 chance level (that is, the probability of 
0.05 of the true population parameter being incorrectly estimated). Exhibit 17.19 summarizes the 
information required to determine sample size. 


Variable Symbol Typical Source of Information 
Standard deviation 5 Pilot study or rule of thumb 

Magnitude of error Ẹ Managerial judgment or calculation (Z Sz) 
Confidence level Zs Managerial judgment 


Estimating Sample Size for Questions Involving Means 


Once the preceding concepts are understood, determining the actual size for a simple random 
sample is quite easy. The researcher must follow three steps: 


Estimate the standard deviation of the population. 
Make a judgment about the allowable magnitude of error. 


we 


Determine a confidence level. 


The judgment about the allowable error and the confidence level are the manager’s decision 
to make. Thus, the only problem is estimating the standard deviation of the population. Ideally, 
similar studies conducted in the past will give a basis for judging the standard deviation. In prac- 
tice, researchers who lack prior information may conduct a pilot study to estimate the population 
parameters so that another, larger sample of the appropriate sample size may be drawn. This pro- 
cedure is called sequential sampling because researchers take an initial look at the pilot study results 
before deciding on a larger sample to provide more precise information. 

A rule of thumb for estimating the value of the standard deviation is to expect it to be about 
one-sixth of the range. If researchers conducting a study on television purchases expected the price 
paid to range from $100 to $700, a rule-of-thumb estimate for the standard deviation would be 
$100. This is also useful when the question is a scaled response on a questionnaire. For example, if 
we plan on using a 10-point purchase intention scale, we can use our rule to determine the esti- 
mate for the standard deviation (10/6 = 1.67). 

For the moment, assume that the standard deviation has been estimated in some preliminary 
work. If our concern is to estimate the mean of a particular population, the formula for sample 
size is 

-E 
E 
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where 
Z = standardized value that corresponds to the confidence level 
S = sample standard deviation or estimate of the population standard deviation 


E = acceptable magnitude of error, plus or minus error factor (range is one-half of the total 
confidence interval)’ 


Suppose a survey researcher studying annual expenditures on lipstick wishes to have a 95 per- 
cent confidence level (Z = 1.96) and a range of error (E) of less than $2. If the estimate of the 
standard deviation is $29, the sample size can be calculated as follows: 

VANS Ee (56.84) 5 
n= (2) =| 5) = = 28.42? = 808 


If a range of error (E) of $4 is acceptable, the necessary sample size will be reduced: 


v= Zp = (C29) = pess 


Thus, doubling the range of acceptable error reduces sample size to approximately one-quarter of 


2 
) = 14.21? = 202 


its original size. Stated conversely in a general sense, doubling sample size will reduce error by only 
approximately one-quarter. 


The Influence of Population Size on Sample Size 


The ACNielsen Company estimates television ratings. Throughout the years, it has been plagued 
with questions about how it is possible to rate 98 million or more television homes with such 
a small sample (approximately 5,000 households). The answer to that question is that in most 
cases the size of the population does not have an effect on the sample size. As we have indicated, 
the variance of the population has the largest effect on sample size. However, a finite correction 
factor may be needed to adjust a sample size that is more than 5 percent of a finite population. If 
the sample is large relative to the population, the foregoing procedures may overestimate sample 
size, and the researcher may need to adjust sample size. The finite correction factor is 


(N =n) 
(N =1) 


where 


N = population size and n = sample size. 


Factors in Determining Sample Size for Proportions 


Researchers frequently are concerned with determining sample size for problems that involve 
estimating population proportions or percentages. When the question involves the estimation 
of a proportion, the researcher requires some knowledge of the logic for determining a con- 
fidence interval around a sample proportion estimation (p) of the population proportion (n). 
For a confidence interval to be constructed around the sample proportion (p), an estimate of 
the standard error of the proportion (S,) must be calculated and a confidence level specified. 

The precision of the estimate is indicated by the value Z,,S, Thus, the plus-or-minus estimate 
of the population proportion is 


Confidence interval = p + Z.S, 


If the researcher selects a 95 percent probability for the confidence interval, Z., will equal 1.96 (see 
Table A.2 in the appendix).The formula for S, is 


, Pa 4 PU- P) 
Sp = „n S= a 
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where 
S, = estimate of the standard error of the proportion 
p = proportion of successes 
q = 1- p, or proportion of failures 


Suppose that 20 percent of a sample of 1,200 television viewers recall seeing an advertisement. 
The proportion of successes (p) equals 0.2, and the proportion of failures (q) equals 0.8.We estimate 
the 95 percent confidence interval as follows: 


Confidence Interval = p + Z.S, 
= 0.2 + 1.965, 


pa — 
=0.2 + 1.962 2 


_ p 0:21 = 0.2) 
=0.2 + 1.96 — T200 


=02+ 1.96) 7500 = 0.2 + 1.96(0.0115) 


= 0.2 + 0.022 


Thus, the population proportion who see an advertisement is estimated to be included in the 
interval between 0.178 and 0.222, or roughly between 18 and 22 percent, with a 95 percent con- 
fidence coefficient. 

To determine sample size for a proportion, the researcher must make a judgment about confi- 
dence level and the maximum allowance for random sampling error. Furthermore, the size of the 
proportion influences random sampling error, so an estimate of the expected proportion of suc- 
cesses must be made, based on intuition or prior information. The formula is 


n= x 
where 
n = number of items in sample 
Zi = square of the confidence level in standard error units 


p = estimated proportion of successes 
q = 1- p, or estimated proportion of failures 


E = square of the maximum allowance for error between the true proportion and the 
sample proportion, or Z.S, squared 


Suppose a researcher believes that a simple random sample will show that 60 percent of the 
population (p) recognizes the name of an automobile dealership. The researcher wishes to estimate 
with 95 percent confidence (Z,, = 1.96) that the allowance for sampling error is not greater than 
3.5 percentage points (E). Substituting these values into the formula gives 


(1.96)2(0.6)(0.4) 
0.0352 


(3.8416) (0.24) 
0.001225 


n= 


_ 0.922 
= 0.001225 


= 753 
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Calculating Sample Size for Sample Proportions 


In practice, a number of tables have been constructed for determining sample size. Exhibit 17.20 
illustrates a sample size table for problems that involve sample proportions (p). 

The theoretical principles underlying calculation of sample sizes of proportions are similar to 
the concepts discussed in this chapter. Suppose we wish to take samples in two large cities, New 


EXHIBIT 17.20 Selected Tables for Determining Sample Size when the Characteristic of Interest Is a Proportion 


Sample Size for a 95 Percent Confidence Level when Parameter in Population 
Is Assumed to Be over 70 Percent or under 30 Percent 


Reliability 
Size of 

Population +1% Point +2% Points +3% Points +5% Points 

1,000 a a 473 244 

2,000 a a 619 278 

3,000 a 1,206 690 291 

4,000 a 1,341 732 299 

5,000 a 1,437 760 303 

10,000 4,465 1,678 823 313 

20,000 5,749 1,832 858 318 

50,000 6,946 17939 881 321 

100,000 7,465 177 888 321 

500,000 to ©% 7,939) 2,009 895 322 


Sample Size for a 95 Percent Confidence Level when Parameter in Population 
Is Assumed to Be over 85 Percent or under 15 Percent 


Reliability 
Size of 
Population +1% Point +2% Points +3% Points +5% Points 
1,000 a a 353 235) 
2,000 a 760 428 266 
3,000 a 890 461 278 
4,000 a 938 479 284 
5,000 a 984 491 289 
10,000 3,288 1,091 516 297; 
20,000 5,935) 1,154 530 302 
50,000 4,461 1,195 538 304 
100,000 4,669 1,210 541 305 
500,000 to © 4,850 1,222 544 306 


aln these cases, more than 50 percent of the population is required in the sample. Since the normal approximation of the hypergeometric distribution is a poor 
approximation in such instances, no sample value is given. 
Source: Lin, Nan, Foundations of Social Research (New York: McGraw-Hill, 1976), 447. Copyright © 1976 by Nan Lin. Used with permission. 
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Orleans and Miami. We wish no more than 2 percentage points of error, and we will be satisfied 
with a 95 percent confidence level (see Exhibit 17.20). If we assume all other things are equal, 
then in the New Orleans market, where 15 percent of the consumers favor our product and 
85 percent prefer competitors’ brands, we need a sample of 1,222 to get results with only 2 per- 
centage points of error. In the Miami market, however, where 30 percent of the consumers favor 
our brand and 70 percent prefer other brands (a less heterogeneous market), we need a sample size 
of 2,009 to get the same sample reliability. 

Exhibit 17.21 shows a sampling error table typical of those that accompany research proposals 
or reports. Most studies will estimate more than one parameter. Thus, in a survey of 100 people 
in which 50 percent agree with one statement and 10 percent with another, the sampling error is 
expected to be 10 and 6 percentage points of error, respectively. 


=XHIBIT 17.21 Allowance for Random Sampling Error (Plus and Minus Percentage Points) at 95 Percent Confidence Level 


Sample Size 


Response 1,000 
10 (90) 12 1:5 2.0 3.0 4.0 6.0 8.0 
20 (80) 1.6 2.0 25 4.0 5.0 8.0 11.0 
30 (70) 1.8 2.5 3.0 4.0 6.0 9.0 13.0 
40 (60) 2.0 25 3.0 4.0 6.0 10.0 14.0 
50 (50) 2.0 25 3.0 4.0 6.0 10.0 14.0 


Source: Lin, Nan, Foundations of Social Research (New York: McGraw-Hill, 1976). Reprinted by permission. 


Determining Sample Size on the Basis of Judgment 


Just as sample units may be selected to suit the convenience or judgment of the researcher, sample 
size may also be determined on the basis of managerial judgments. Using a sample size similar to 
those used in previous studies provides the inexperienced researcher with a comparison with other 
researchers’ judgments. 

Another judgmental factor that affects the determination of sample size is the selection of the 
appropriate item, question, or characteristic to be used for the sample size calculations. Several 
different characteristics affect most studies, and the desired degree of precision may vary for these 
items. The researcher must exercise some judgment to determine which item will be used. Often 
the item that will produce the largest sample size will be used to determine the ultimate sample 
size. However, the cost of data collection becomes a major consideration, and judgment must be 
exercised regarding the importance of such information. 

Another consideration stems from most researchers’ need to analyze various subgroups within 
the sample. For example, suppose a researcher wants to look at employee attitudes, but is particu- 
larly interested in differences across genders and age groups. The analyst will want to make sure 
to sample an adequate number of men and women, as well as across the various age groups to 
ensure that subgroup comparisons are reliable. There is a judgmental rule of thumb for selecting 
minimum subgroup sample size: Each subgroup to be separately analyzed should have a minimum 
of 100 units in each category of the major breakdowns. With this procedure, the total sample size 
is computed by totaling the sample sizes necessary for these subgroups. 


Determining Sample Size for Stratified 
and Other Probability Samples 


Stratified sampling involves drawing separate probability samples within the subgroups to make 
the sample more efficient. With a stratified sample, the sample variances are expected to differ by 
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e Population parameters are the 
numerical characteristics of a population. 
Statistics are the numerical characteristics of 
a sample. 
e Thus, a parameter represents for a population 
what a statistic represents for a sample. 
When we know all the information from all members of the 
population, we don't need inferential statistics. For example, 
if we find that the average grade on the business research 
exam for our class is 86 for women and 84 for men, we can 
conclude that—on average—women in our class scored 
higher than men in our class. In this case, the population 
of interest is our class. We do not need to do any statistical 
test. However, if we want to project these results onto all 
women and men taking the business research class at all 
universities, then we would need to use inferential statis- 
tics. The exact statistical test we would use is discussed in 
Chapter 21. 


The three measures of central tendency discussed in this 
chapter each have their own strengths and weaknesses. The 
mean is very commonly used as it represents the arithmetic 
average of all the observations. However, the mean can be 
misleading, especially when there are outliers in the data. In 
this case, the median is usually a better indicator of the “aver- 
age” value. This is common in situations such as income or 
real estate prices. 

The formula for calculating sample size is based on three 
factors—the level of confidence, the acceptable error, and 
the variance in the population. For all practical purposes, the 
size of the population does not matter. Consider an employee 
satisfaction study. If we have 100,000 employees and they all 
feel exactly the same (no variance), we would only have to talk 
to one employee to know how satisfied they were. However, 
if we have 10 employees, but they all have very different 
attitudes, we might need to talk to all 10. The variance in the 
population is the key issue, not the size of the population. 


strata. This makes the determination of sample size more complex. Increased complexity may also 
characterize the determination of sample size for cluster sampling and other probability sampling 
methods. The formulas are beyond the scope of this book. Students interested in these advanced 
sampling techniques should investigate advanced sampling textbooks. 


Determining Level of Precision after Data Collection 


Up to this point, we have discussed the process for determining how large of a sample we need to 
collect given the estimated variance among the responses and our desired level of precision and 
acceptable error. This is a very important consideration for researchers. However, after we have 
collected the data, we also want to determine our level of precision, given the size of the sample, 
the variance, and the confidence level. In this case, we can rewrite our equation for determining 
sample size: 
ZS\° 
"= 
Rather than solving for n, we now know n and instead want to solve for E, the magnitude of error. 
Our new equation would be: 
(ZS) 
n 


2 — 


So, we could solve for E’, and then take the square root of this to determine our level of precision. 
This is a useful approach to use after-the-fact to show our final level of precision. In our earlier 
example of sample size regarding lipstick expenditures, we found that if we wanted to be 95% con- 
fident (Z value of 1.96) that our estimate of expenditures was within $2.00 and we had a standard 
deviation of $29.00, we would need a sample size of 808. Using the same situation, let’s assume we 
had already collected the data, but were not certain of our level of precision. Our formula above 
would show: 


(1.96*29)’/808 = 4 
The square root of 4 is 2. 


When completing a research project it is often a good idea to provide managers with the level of 
precision for key measures. This formula will allow you to do so. 
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A Reminder about Statistics 


Learning the terms and symbols defined in this chapter will provide you with the basics of the 
language of statisticians and researchers. As you learn more about the pragmatic use of statistics in 
marketing research, do not forget these concepts. Rules are important in learning a foreign lan- 
guage and when the rules are forgotten, being understood becomes very difficult. The same is true 
for the student who forgets the basics of the “foreign language” of statistics. 


Summary 


1. Understand basic statistical terminology. Determination of sample size requires a knowledge 
of statistics. Statistics is the language of the researcher, and this chapter introduced its vocabulary. 
Descriptive statistics describe characteristics of a population or sample. Thus, calculating a mean 
and a standard deviation to “describe” or profile a sample is a commonly applied descriptive sta- 
tistical approach. Inferential statistics investigate samples to draw conclusions about entire popula- 
tions. If a mean is computed and then compared to some preconceived standard, then inferential 
statistics are being implemented. 


2. Interpret frequency distributions, proportions, and measures of central tendency and 
dispersion. A frequency distribution shows how frequently each response or classification occurs. 
A simple tally count illustrates a frequency distribution. A proportion indicates the percentage 
of group members that have a particular characteristic. Three measures of central tendency are 
commonly used: the mean, or arithmetic average; the median, or halfway value; and the mode, 
or most frequently observed value. These three values may be either the same or they may differ, 
and care must be taken to understand distortions that may arise from using the wrong measure of 
central tendency. Measures of dispersion further describe a distribution. The range is the difference 
between the largest and smallest values observed. The most useful measures of dispersion are the 
variance (the summation of each observation’s deviation from the mean, divided by one less than 
the number of observations) and standard deviation, which is the square root of the variance. 


3. Distinguish among population, sample, and sampling distributions. The techniques of sta- 
tistical inference are based on the relationship among the population distribution, the sample 
distribution, and the sampling distribution. The population distribution is a frequency distribution 
of the elements of a population. The sample distribution is a frequency distribution of a sample. 
A sampling distribution is a theoretical probability distribution of sample means for all possible 
samples of a certain size drawn from a particular population. The sampling distribution’s mean is 
the expected value of the mean, which equals the population’s mean. The standard deviation of 
the sampling distribution is the standard error of the mean, approximately equal to the standard 
deviation of the population, divided by the square root of the sample size. 


4. Explain the central-limit theorem. The central-limit theorem states that as sample size increases, 
the distribution of sample means of size n, randomly selected, approaches a normal distribution. 
This theoretical knowledge can be used to estimate parameters and determine sample size. 


5. Summarize the use of confidence interval estimates. Estimating a population mean with a 
single value gives a point estimate. The confidence interval estimate is a range of numbers within 
which the researcher is confident that the population mean will lie. The confidence level is a 
percentage that indicates the long-run probability that the confidence interval estimate will be 
correct. Many research problems involve the estimation of proportions. Statistical techniques may 
be used to determine a confidence interval around a sample proportion. 


6. Discuss the major issues in specifying sample size. The statistical determination of sample size 
requires knowledge of (1) the variance of the population, (2) the magnitude of acceptable error, 
and (3) the confidence level. Several computational formulas are available for determining sample 
size. Furthermore, a number of easy-to-use tables have been compiled to help researchers calcu- 
late sample size. The main reason a large sample size is desirable is that sample size is related to 
random sampling error. A smaller sample makes a larger error in estimates more likely. Calculation 
of sample size for a sample proportion is not difficult. However, most researchers use tables that 
indicate predetermined sample sizes. 
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Questions for Review and Critical Thinking 


1. What is the difference between descriptive and inferential sales of the item at a similar outlet and observed the following 
statistics? results: 
2. Suppose the speed limits in 13 countries in miles per hour are = ; 
as follows: X = 500 (mean daily sales) 
s = 100 (standard deviation of sample) 
Country Highway Miles per Hour n = 25 (sample size) 
Italy 87 . 
Pence 81 The restaurant manager wants to know into what range the 
H 75 mean daily sales should fall 95 percent of the time. Perform this 
ungary 
: calculation. 
Belgium 75 oe 
Portugal 75 11. In our example of research on lipstick, where T = $2 and 
Goa Britain 70 S = $29, what sample size would we require if we desired a 
Spain 62 99 percent confidence level? What about if we keep the 95% 
D È 62 confidence level, but decide that our acceptable error is $4? 
enmar! ; á 
Nëttierland; 62 12. Suppose you are planning to sample cat owners to determine 
Guess 62 the average number of cans of cat food they purchase monthly. 
Japan 62 The following standards have been set: a confidence level of 
Norway 56 99 percent and an error of less than five units. Past research has 
Turkey 56 indicated that the standard deviation should be 6 units. What is 
the required sample size? 
What is the mean, median, and mode for these data? Feel free 13. In a survey of 500 people, 60 percent responded with agree- 
to use your computer (statistical software or spreadsheet) to get ment to an attitude question. Calculate a confidence interval at 
the answer. 95 percent to get an interval estimate for a proportion. 
3. Prepare a frequency distribution for the data in question 2. 14. What is a standardized normal curve? 
4. Why is the standard deviation rather than the average deviation 15. A researcher expects the population proportion of Cubs fans 
typically used? in Chicago to be 80 percent. The researcher wishes to have an 
5. Calculate the standard deviation for the data in question 2. error of less than 5 percent and to be 95 percent confident of 
6. Draw three distributions that have the same mean value but an estimate to be made from a mail survey. What sample size is 
different standard deviation values. Draw three distributions required? 
that have the same standard deviation value but different mean 16. ETHICS Using the formula in this chapter, a researcher deter- 
values. mines that at the 95 percent confidence level, a sample of 2,500 
7. A manufacturer of MP3 players surveyed one hundred retail is required to satisfy a client’s requirements. The researcher 
stores in each of the firm’s sales regions. An analyst noticed that actually uses a sample of 1,200, however, because the client has 
in the South Atlantic region the average retail price was $165 specified a budget cap for the survey. What are the ethical con- 
(mean) and the standard deviation was $30. However, in the siderations in this situation? 
Mid-Atlantic region the mean price was $170, with a standard 17. ‘NET Go to http://www.dartmouth.edu/~chance/ to visit the 
deviation of $15. What do these statistics tell us about these two Chance course. The Chance course is an innovative program 
sales regions? to creatively teach introductory materials about probability and 
8. What is the sampling distribution? How does it differ from the statistics. The Chance course is designed to enhance quantitative 
sample distribution? literacy. Numerous videos can be played online. 
9. What would happen to the sampling distribution of the mean if 18. ‘NET Go to http://www.researchinfo.com. Click on “Marketing 
we increased sample size from 5 to 25? Research Calculators.” Which of the calculators can be used 
10. Suppose a fast-food restaurant wishes to estimate average sales to help find the sample size required? How big of a sample 


volume for a new menu item. The restaurant has analyzed the 


is needed to make an inference about the U.S. population 
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19. 


+5 percent? How large a sample is needed to make an infer- 
ence about the population of Norway +5 percent? Remember, 
population statistics can be found in the CIA World Factbook 
online. Comment. 

‘NET A random number generator and other statistical informa- 
tion can be found at http://www.random.org. Flip some virtual 


Research Activities 


N 


‘NET Go to http://www.surveypro.com. Click on pricing. Write a 
brief report that describes how prices are charged to someone 
wishing to use this service to host a survey. What happens as the 
desired sample size increases? Why is this? 

‘NET Use an online library service to find basic business research 
studies that report a “response rate” or number of respondents 
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coins. Perform 20 flips with an Aurelian coin. Perform 20 flips 
with a Constatius coin. Perform frequency tables for each result. 
What conclusion might you draw? Would the result change if 
you flipped the coins 200 times or 2,000 times? 


journals such as the Journal of Business Research, the Journal of 
Marketing, or the Journal of Management. Find at least 25 such 
studies. What is the average response rate across all of these stud- 
ies? Do there appear to be any trends or factors that are associ- 
ated with lower response rates? Write a brief report on your 


findings. 


compared to number of contacts. You may wish to consult 


Case 17.1 Pointsec Mobile Technologies 


When salespeople, construction supervisors, of taxi fleets in each city, the researchers came up with city-by-city 


managers, and other employees are away from numbers: 3.42 cell phones per cab yielded 85,619 cell phones left 


a é the workplace, many of them carry mobile behind in Chicago, for example. In London, the researchers con- 

2 z devices such as laptop computers and PDAs, cluded 63,135 cell phones were left in cabs, a startling increase of 71 
Fe often containing valuable, private data related percent compared to four years earlier. 

A 

oa 


to their jobs. Pointsec (http://www.checkpoint. 
com/pointsec) provides security systems to pro- Questions 
tect such data. To bring home the vulnerability of mobile devices, il, 
Pointsec decided to share information about the number of such 

devices left behind in taxis.” 


Discuss why the sampling method and sample size make these 
results questionable, even though the numbers were reported as 
if they were precise. 


The research involved conducting a survey of taxi drivers. Staff 2. The simple survey method described in the case may have been 
members at Pointsec’s public relations firm called major taxi compa- 
nies in nine cities in Australia, Denmark, Finland, France, Germany, 
Norway, Sweden, Great Britain, and the United States. Each of the 


cooperating companies put these interviewers in touch with about 


sufficient as a way to draw attention to the issue of data secu- 
rity. However, if the company were using data on lost mobile 
devices to predict demand for a product, accuracy might be 

more significant. Imagine that you have been asked to collect 
one hundred drivers. Drivers were asked how many devices of each 
type—cell phones, PDAs, computers, and so on—had been left in 

their cab over the preceding six months. From these numbers, they 
came up with the rate of items left behind. Multiplying by the size 


data on mobile devices left in cabs, and you wish to be able to 
report results with a 95 percent confidence level. How can you 
improve the sample design and select an appropriate sample 
size? 


After studying this chapter, you should be able to 
1. Describe the role and job requirements of fieldworkers 


2. Summarize the skills to cover when training inexperi- 
enced interviewers 


3. List principles of good interviewing 
. Describe the activities involved in the management of 
fieldworkers 


Discuss how supervisors can minimize errors in the field 


Chapter Vignette: Software for Fieldwork? Ask Askia 


Fieldwork is difficult to quantify, but it can best be described as collecting data “out there.” 
Whether it is in a mall or customer service location or even in remote towns and villages, 
fieldwork requires a researcher to oftentimes directly interact with consumers and households 
to gather specialized or detailed data. In the past, fieldworkers used notebooks and clipboards 
to gather data, capturing information by hand as they interacted with the respondent. Once the 
information was collected, the fieldworker often would return to the research organization and 
arduously code the handwritten notes into a database or statistical package. Fortunately, 
technology has made this process significantly easier. 
One example of a company that has specialized in face-to-face fieldwork software is Askia 


Askia has developed a fully functioning software application that works with tablet PCs and 
PDAs for field researchers. Their system (Askia Face) represents an 


important advantage to field research, since i 


their interface provides seamless 
integration with telephone-assisted 
survey databases and an ability 
to directly download data into an 
analysis program. The Askia Face 
system fieldworkers can have their 
survey applications updated on- 
the-fly, without having to return 
to their research base to update 
materials. Users can even use multime- 
dia to present products or services, or 
provide illustrations for the respondent. 
Askia has developed client relationships 
with companies around the world, and 
has seen the number of their customers 
triple each year. 


Conducting field research is hard enough, without having the proper quality control and 
information turnaround that is so critical these days. The ability to capture and integrate field 
notes and information through Askia Face is one example of how technology has assisted 


fieldwork research. So, if you are challenged by your own fieldwork data needs, perhaps you 
too should “Ask Askia”! 
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fieldworker 


An individual who is responsible 
for gathering data in the field. 


field interviewing service 


A research supplier that 
specializes in gathering data. 


in-house interviewer 


A fieldworker who is employed 
by the company conducting 
the research. 
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Introduction 


Much of the work of a business researcher involves interacting with stakeholders within the 
organization. But when it is required, the researcher must conduct data collections with poten- 
tial clients or customers outside of the firm. Similar to the term used for anthropologists or 
biologists who must go into far-away countries or into local fields and forests, this is referred to 
as working “in the field,” or fieldwork. This chapter highlights this critical activity for business 
researchers. 


The Nature of Fieldwork 


A personal interviewer administering a questionnaire door to door, a telephone interviewer calling 
from a central location, an observer counting pedestrians in a shopping mall, and others involved 
in the collection of data and the supervision of that process—each of these people is a fieldworker. 
The activities they perform vary substantially. The supervision of data collection for a mail survey 
differs from that for an observation study as much as the factory production process for cereal dif- 
fers from that for a pair of ski boots. Yet, just as quality control is basic to each production opera- 
tion, the same basic issues arise in the various types of fieldwork. For ease of presentation, this 
chapter focuses on the interviewing process conducted by personal interviewers. However, many 
of the issues apply to all fieldworkers, no matter what their specific settings. 


Who Conducts the Fieldwork? 


The actual data collection process is rarely carried out by the person who designs the research. 
However, the data-collecting stage is crucial, because the research project is no better than the 
data collected in the field. So, the research director must select capable people and trust them to 
gather the data. An irony of business research is that highly educated and trained individuals design 
the research, but when typical surveys are conducted, the people who gather the data usually have 
little research training or experience. Knowing that research is no better than the data collected in 
the field, research administrators must concentrate on carefully selecting fieldworkers. 

Much fieldwork is conducted by research suppliers that specialize in data collection. When 
a second party is subcontracted, the job of the study designer at the parent firm is not only to hire 
a research supplier but also to build in supervisory controls over the field service. In some cases a 
third-party firm is employed. For example, a company may contact a research firm that in turn 
subcontracts the fieldwork to a field interviewing service. 

As seen in the Research Snapshot on p. 446, various field interviewing services and full- 
service research agencies perform all manner of personal surveys including central location 
telephone interviewing, mall-intercepts, and other forms of fieldwork for a fee. These agencies 
typically employ field supervisors who supervise and train interviewers, edit completed question- 
naires in the field, and telephone or recontact respondents to confirm that interviews have been 
conducted. 

Whether the research administrator hires an in-house interviewer or selects a field interview- 
ing service, fieldworkers should ideally meet certain job requirements. Although the job require- 
ments for different types of surveys vary, normally interviewers should be healthy, outgoing, and 
of pleasing appearance—that is, well-groomed and tailored. People who enjoy talking with 
strangers usually make better interviewers. An essential part of the interviewing process is estab- 
lishing rapport with the respondent. An outgoing nature may help interviewers ensure respon- 
dents’ full cooperation. Interviewer bias may occur if the fieldworker’s clothing or physical 
appearance is unattractive or unusual. One exception to this would be ethnographic research. In 
ethnographic research, the interviewer should dress to blend in with the group being studied. 
So, if holey jeans and a dirty T-shirt are the dress du jour, then the interviewer should dress 
likewise. 


yi) Take a look at the section of the 
$ questionnaire shown in this pic- 
í V ture. Respondents answered these 
Y questions without the benefit of 
K an interviewer. Do you think an 
interviewer could help provide better 
answers to these questions? Consider the 
pros and cons of a personal interviewer or a telephone 
interviewer for this type of information. What would 
your recommendation be to a researcher conduct- 
ing this type of interview? If you think an interviewer 
should be used, explain why and give an indication of 
the instructions the fieldworker should receive. If you 
do not believe an interviewer would be helpful, explain 
how the interviewer may actually contribute to lower 
quality in responses. 
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your personal development (9) (9) 


your performance in school 


your social life 


Survey interviewers generally are paid hourly rates or per-interview fees. Often interviewers 
are part-time workers from a variety of backgrounds—homemakers, graduate students, school- 
teachers, and others. Some research projects require special knowledge or skills, such as familiarity 
with the topic they are asking about. In a survey investigating whether health education improves 
the likelihood that people who have suffered a stroke will quit smoking, the researchers used 
trained nurses to administer questionnaires that included each patient’s medical history.” Taking 
an accurate medical history is a skill that requires more training than most interviewers would 
likely have. 


In-House Training for 
Inexperienced Interviewers 


After personnel are recruited and selected, they must be trained.’ Suppose a woman who has just 
sent her youngest child off to first grade is hired by a research interviewing firm. She has decided to 
become a professional interviewer. The training she will receive after being hired may vary from 
virtually no training to an extensive, three-day program if she is selected by one of the larger research 
companies. Almost always, trainees will receive a briefing session on the particular project. 

The objective of training is to ensure that the data collection instrument will be administered 
in a uniform fashion by all fieldworkers. The goal of training sessions is to ensure that each respon- 
dent is provided with common information. If the data are collected in a uniform manner from all 
respondents, the training session will have succeeded. 

More extensive training programs are likely to cover the following topics: 


e How to make initial contact with the respondent and secure the interview 
e How to ask survey questions 

e How to probe 

e How to record responses 

e How to terminate the interview 


Typically, recruits record answers on a practice questionnaire during a simulated training 
interview. 


The knowledge of the 
world is only to be 
acquired in the world 
and not in the closet. 
—Lord Chesterfield 


briefing session 


A training session to ensure that 
each interviewer is provided with 
common information. 
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COURTESY OF QUALTRICS.COM 
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Interviewing for Horizon Research Services 
Along with the big-name national and international research 


firms like Yankelovich, Nielsen, and Gallup, many smaller research 
companies offer interviewing and other services to clients in their 


city or region. An example is Horizon Research Services (http:// 
www.horizonresearch.com), located in Columbia, Missouri. Founded 
by Kathleen Anger, a psychologist with a deep sense of curios- 
ity, Horizon has served local organizations including Columbia’s 
banks and hospitals. The company conducts focus groups, tele- 
phone surveys, and other research projects. 

One of the most significant challenges of the interviewer's 
job is simply to keep the respondent from hanging up. In the 
first few seconds of the phone call, fieldworkers quickly reassure 
the person that the call is for 
research, not to sell them 
something. After that, retain- 
ing respondents becomes 
a matter of reinforcing that 
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they are “doing a good service [because] it’s 
for research.” 

Horizon’s telephone interviewers 
also recruit people to participate in focus 
groups. Typically, the company needs four 
interviewers to spend about three hours just to 


fill a twelve-person focus group. The reason is that finding willing 


individuals who meet the project's specifications may require up 
to six hundred phone calls! 

Horizon has recently formed partnerships with World 
Marketing and Fusion Marketing & Design. As a result, a 
researcher can get both consulting services and creative design 
to go along with the field research. In the end, they can get the 
total package by using all three partners together. 


Source: Based on Coleman, Kevin, “Research Firm Reflects Consumer Trends,” 
Columbia (Missouri) Daily Tribune (May 21, 2005), downloaded from http://www. 
columbiatribune.com; and Horizon Research Services Web site, http://www. 
horizonresearch.com, accessed March 27, 2006. 


Fieldworkers need training 
both in the basics and required 
practices or good interviewing 
principles. 


446 


Making Initial Contact and Securing the Interview 
PERSONAL INTERVIEWS 


Personal interviewers may carry a letter of identification or an ID 
card to indicate that the study is a bona fide research project and not 
a sales pitch. Interviewers are trained to make appropriate opening 
remarks that will convince the respondent that his or her coopera- 
tion is important, as in this example: 


Good afternoon, my name is 


survey concerning 
ideas. It will take [insert accurate time estimate] minutes. 


TELEPHONE INTERVIEWS 


For the initial contact in a telephone interview, the introduction 
might be something like this: 


Good evening, my name is 


only take [insert accurate time estimate] minutes of your time. 


Giving the interviewer’s name personalizes the call. The name 
of the research agency is used to imply that the caller is trustworthy. 
The respondent must be given an accurate estimate of the time it 
will take to participate in the interview. If someone is told that only 
three minutes will be required for participation, and the interview 
proceeds to five minutes or more, the respondent will tend to quit 
before completing the interview. Providing an accurate estimate of 
the time not only helps gain cooperation, but it is also the ethically 
correct thing to do. 


, and Pm with [insert 
name of firm], an international research company. We are conducting a 
. I would like to get a few of your 


. I am not trying to 
sell anything. I’m calling from [insert name of firm] in Mason, Ohio. 
We are seeking your opinions on some important matters and it will 
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INTERNET SURVEYS 


A similar approach may be used to an Internet survey. The potential respondent may receive an 
e-mail requesting assistance, as in the following example: 


We are contacting you because of your interest in [subject matter inserted here]. We would like to invite 
you to participate in a survey that asks your opinion on matters related to [subject matter inserted here]. 
In return for your participation, we will [insert incentive here]. To participate, click on this URL: http: // 
www.clickhere.com. 


GAINING PARTICIPATION 


The Interviewer’s Manual from the Survey Research Center at the University of Michigan recom- 
mends avoiding questions that ask permission for the interview, such as “May I come in?” and 
“Would you mind answering some questions?” Some people will refuse to participate or object to 
being interviewed. Interviewers should be instructed on handling objections. For example, if the 
respondent says, “I’m too busy right now,” the interviewer might be instructed to respond, “Will 
you be in at four o’clock this afternoon? I would be happy to schedule a time with you.” In other 
cases, client companies will not wish to offend any individual. In this case, the interviewer will be 
instructed to merely say, “Thank you for your time.” 

The foot-in-the-door compliance technique and the door-in-the-face compliance technique are 
useful in securing interviews. Foot-in-the-door theory attempts to explain compliance with a 
large or difficult task on the basis of respondents’ earlier compliance with a smaller initial request. 
One experiment has shown that compliance with a minor telephone interview (that is, a small 
request that few people refuse) will lead to greater compliance with a second, larger request to fill 
out a long mail questionnaire. An interviewer employing door-in-the-face technique begins by 
making an initial request so large that nearly everyone will react negatively (that is, slams the door 
in his or her face). When this happens, the interviewer can then request a smaller favor, such as 
asking a respondent to participate in a “short” survey. However, this technique presents an ethical 
issue if the respondent is deceived. Thus, the initial request should also be a legitimate request. 


Asking the Questions 


The purpose of an interview is, of course, to record a respondent’s answers. Training in the art of 
asking questions can be extremely beneficial, because interviewer bias can be a source of consider- 
able error in survey research. 

There are five major rules for asking questions: 


Ask questions exactly as they are worded in the questionnaire. 
Read each question very carefully and clearly. 

Ask the questions in the specified order. 

Ask every question specified in the questionnaire. 


oe SS 


Repeat questions that are misunderstood or misinterpreted.* 


Interviewers are generally trained to know these rules, but when working in the field, many do 
not follow these procedures exactly. Inexperienced interviewers may not understand the impor- 
tance of strict adherence to the instructions. Even professional interviewers take shortcuts when 
the task becomes monotonous. Interviewers may shorten questions or rephrase unconsciously 
when they rely on their memory of the question rather than reading the question as it is worded. 
Even the slightest change in wording may inject some bias into a study. By reading the question, 
the interviewer may be reminded to concentrate on avoiding slight variations in tone of voice on 
particular words or phrases. 

If respondents do not understand a question, they usually will ask for some clarification. The 
recommended procedure is to repeat the question. If the person does not understand a word 
such as HDTV (high definition television) in the question “Do you feel HDTV should be the 
standard delivery for television networks?” the interviewer should respond with the full name 
of the acronym. If the respondent still doesn’t understand, then the interviewer may say, “Just 
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foot-in-the-door 
compliance technique 


A technique for obtaining a high 
response rate, in which compli- 
ance with a large or difficult task 
is induced by first obtaining the 
respondent's compliance with a 
smaller request. 


door-in-the-face 
compliance technique 


A two-step process for securing 

a high response rate. In step 1 an 
initial request, so large that nearly 
everyone refuses it, is made. Next, 
a second request is made for a 
smaller favor; respondents are 
expected to comply with this 
more reasonable request. 
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Why Is “Why” Important? 
The use of field interviews to answer specific research questions really determine success—visitors can stop 
has many logistic and quality management challenges, but in many by for any number of reasons—the real 

ways field interviews are unique in the ability to really capture what question is why they stopped by the booth. 


became clear that counting visitors does not 


a respondent is thinking about. This is due to the very nature of Calo assisted the company by conduct- 
the field interview—the ability to follow up and probe deeperona ing a short interview that asked why the visitor 
respondent's initial response. A key way that interviewers can cap- to the booth was there, and what got their attention when they 
ture this is through asking “why” follow-up questions. first appeared. This allowed the company to understand what 
Calo Research Services makes asking “why” their business. was really connecting visitors to their booth, and allowed them 
Whether it is for consumer research or for managerial strategy, to build on what was successful for their other presentations 
Calo Research Services has adopted a philosophy from the top around the country. 
down that stresses the importance of asking why. For example, Field interviewers that can probe deeper into the question 
a company that was a participant in a professional trade show of interest will recognize the value of this approach. Because 
determined that capturing the face-to-face interview can help tease out this kind of 
the number of visitors to information—why not take advantage of this approach? 
Huo beoi wouk. alp unem Source: Calo Research Services, Inc., http://www.caloresearch.com, accessed 
evaluate the success of their April 8, 2009. 


presentation. However, it 
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whatever it means to you.” However, interviewers often supply their own personal definitions 
and ad lib clarifications, and they may include words that are not free from bias. One reason 
interviewers do this is that field supervisors tend to reward people for submitting completed 
questionnaires and to be less tolerant of interviewers who leave questions blank because of 
alleged misunderstandings. 

Often respondents volunteer information relevant to a question that is supposed to be asked at 
a later point in the interview. In this situation the response should be recorded under the question 
that deals specifically with that subject. Then, rather than skip the question that was answered out 
of sequence, the interviewer should be trained to say something like “We have briefly discussed 
this, but let me ask you. . . .” By asking every question, the interviewer can be sure that complete 
answers are recorded. If the partial answer to a question answered out of sequence is recorded on 
the space reserved for the earlier question and the subsequent question is skipped, an omission 
error will occur when the data are tabulated. 


Probing When No Response Is Given 


Similar to the approach discussed for qualitative interviews, interviewers should be provided 
instructions on how to probe when respondents give no answer, incomplete answers, or answers 
that require clarification. As demonstrated in the two preceding snapshots, probing questions can 
help in the clarification of a question within the interview process. By asking “why” carefully, the 
researcher can gain additional insight into the thoughts, attitudes, and behaviors of the respondent. 
First, probing is necessary when a respondent must be motivated to expand on, clarify, explain, 
or complete his or her answer. Interviewers must encourage respondents to clarify or expand on 
answers by providing a stimulus that will not suggest their own ideas or attitudes. An ability to 
probe with neutral stimuli is a mark of an experienced and effective interviewer. Second, probing 
may be necessary when a respondent begins to ramble or lose track. In such cases, a respondent 
must be led to focus on the specific content of the interview and to avoid irrelevant and unneces- 
sary information. 

Interviewers have several possible probing tactics to choose from, depending on the situation: 


e Repeating the question. When the respondent remains completely silent, he or she may not 
have understood the question or decided how to answer it. Mere repetition may encourage 
the respondent to answer in such cases. For example, if the question is “What do you not like 
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l Probing for Deeper Meaning Researchers then use computer software to identify response 
= ~ at Olson Zaltman Associates patterns that suggest “metaphors” for the product—a general 
At Olson Zaltman Associates, highly theme that describes respondents’ attitudes. In a study of air 
trained interviewers probe for the deeper thinking fresheners, people want to avoid having odors in their home 
that underlies attitudes toward brands or product alienate them from visitors (an underlying desire for connection 
categories. The research firm’s method, called ZMET (for Zaltman with others); they also want an air freshener to seem natural, 
Metaphor Elicitation Technique), begins by asking each respon- rather than masking something (an underlying desire to evoke 
dent to come to a one-on-one interview, bringing along a set of nature). Based on these ideas, the client developed Breeze air 
eight to ten photographs related to their thoughts and feelings freshener. In another project, Motorola hired Olson Zaltman to 


about the interview’s topic. The interviewer uses the photos as help it market a high-tech security system. Many research par- 

nonverbal clues about the associations the person makes with ticipants brought in images of dogs, signifying the protection 

the product or brand. that dogs give their owners. As a result, Motorola avoided brand 
A typical interview lasts two hours. The interviewer's chal- names emphasizing technology, instead calling the new system 


lenge is to ask questions that reveal what is behind the selection the Watchdog. 


of the photographs without actually suggesting the interviewer's Source: Based on Wielaard, Robert, “What People Don’t Know They Know,’ 


own ideas. The interviewer begins by asking the respondent to America’s Intelligence Wire (December 8, 2005), downloaded from http://www. 
describe the topic-related thoughts and feelings that each pic- accessmylibrary.com; Olson Zaltman Associates, home page and “What We Do,’ 
ture illustrates. The interviewer then probes to uncover a deeper _‘Mtth//wwwolsonzaltman.com, 

u ; p u p accessed March 23, 2006; Christensen, 


meaning by asking the respondent to elaborate on the initial Glenn L. and Jerry C. Olson, “Mapping 
statements. This process requires skill based on training in fields Consumers’ Mental Models with ZMET, 

4 z Psychology & Marketing 19, no. 6 (June 
such as psychotherapy and sociology. Finally, the respondent 2002): 477-502. 


works with an associate to create a computerized collage that 
illustrates the respondent's thoughts and feelings about the topic. 
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about Guinness?” and the respondent does not answer, the interviewer may probe: “Just to 
check, is there anything that you do not like about Guinness?” 

e Using a silent probe. If the interviewer believes that the respondent has more to say, a silent 
probe—that is, an expectant pause or look—may motivate the respondent to gather his or her 
thoughts and give a complete response. 

e Repeating the respondent’s reply. As the interviewer records the response, he or she may repeat the 
respondent’s reply verbatim. This may stimulate the respondent to expand on the answer. 

e Asking a neutral question. Asking a neutral question may specifically indicate the type of infor- 
mation that the interviewer is seeking. For example, if the interviewer believes that the 
respondent’s motives should be clarified, he or she might ask, “Tell me about this feeling.” 
If the interviewer feels that there is a need to clarify a word or phrase, he or she might say, 
“What do you mean by 2” Exhibit 18.1 on the next page lists some common 
interview probes and the standard abbreviations that are recorded on the questionnaire with 
the respondent’s answers. 


The purpose of asking questions as probes is to encourage responses. Such probes should be 
neutral and not leading. Probes may be general (such as “Anything else?”) or they may be ques- 
tions specifically designed by the interviewer to clarify a particular statement by the respondent. 


Recording the Responses 


An analyst who fails to instruct fieldworkers in the techniques of properly recording survey answers 
rarely forgets to do so a second time. Although recording an answer seems extremely simple, 
mistakes can occur in this phase of the research. Each fieldworker should use the same recording 
process. The opening chapter vignette demonstrates how one company is harnessing technology 
to help with this recording process. 
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EXHIBIT 18.1 
Commonly Used Probes and 
Their Abbreviations 
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Interviewer’s Probe Standard Abbreviation 


Repeat question (RQ) 

Anything else? (AE or Else?) 
Any other reason? (AO?) 

Any others? (Other?) 

How do you mean? (How mean?) 
Could you tell me more about your thinking on that? (Tell more) 
Would you tell me what you have in mind? (What in mind?) 
What do you mean? (What mean?) 
Why do you feel that way? (Why?) 

Which would be closer to the way you feel? (Which closer?) 


Source: Survey Research Center, Interviewer’s Manual, rev. ed. (Ann Arbor, MI: Institute for Social Research, University of Michigan, 
1976), p. 16. Reprinted by permission. 


Rules for recording responses to fixed-alternative questions vary with the specific question- 
naire. A general rule, however, is to place a check mark in the box that correctly reflects the 
respondent’s answer. All too often interviewers don’t bother recording the answer to a filter 
question because they believe the subsequent answer will make the answer to the filter question 
obvious. However, editors and coders do not know how the respondent actually answered a 
question. 

The general instruction for recording open-ended questions is to record the response verba- 
tim, a task that is difficult for most people. Inexperienced interviewers should be given an oppor- 
tunity to practice verbatim recording of answers before being sent into the field. Some suggestions 
for recording open-ended answers include 


e Record responses during the interview. 

e Use the respondent’s own words. 

e Do not summarize or paraphrase the respondent’s answer. 
e Include everything that pertains to the question objectives. 
e Include all of your probes.” 


Especially for sensitive topics, decisions about how to record responses may be more difficult than 
these guidelines suggest. For a survey that included open-ended questions about sexual behavior, 
researchers found that some decisions about how to record answers affected the way responses were 
later interpreted. For example, they defined notation that would indicate pauses and vocal emphasis, 
which helped researchers identify answers that involved confusion or strong emotions. However, 
recording every nonverbal behavior led researchers to speculate about whether one respondent was 
crying or using drugs (he had a cold). Likewise, when transcriptions recorded the respondent’s exact 
words and pronunciation, including dialects and mistakes in grammar and word usage, researchers 
were tempted to speculate about demographic characteristics, such as a speaker’s race or educational 
level. As the researchers evaluated the effects of these decisions about how to record answers, they 
concluded that such decisions should be made carefully in light of the research objectives.° 

Exhibit 18.2 shows an example of a completed questionnaire page. Note how the interviewer 
adds supplementary comments to the fixed-alternative questions and indicates probes used to gain 
a response. Answers have been recorded without paraphrasing. In this case, the interviewer has 
resisted the temptation to conserve time and space by filtering comments. The RQ recorded in 
question A4a indicates a repeat-question probe. 
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Example of a Completed 
Questionnaire Page 


EXAMPLE OF COMPLETED QUESTIONNAIRE PAGE 


Al, We are interested in how people are getting along financially these days. 
Would you say that you (and your family) are better off or worse off 
financially than you were a year ago? 


(IF NOT ALREADY ANSWERED) 


+ 


A2. Are you (and your family) receiving as much income now as you were a year 
ago, or more, or less? 


Sarr 
KE nou | | 3. ABOUT THE SAME | 5. LESS NOW t 


Tus you! (See fia) 


A3. Now looking ahead--do you think that a year from now you (and your family) 
Uee be better off financially, or worse off, or just about the same as now? 


WILL BE | | 
NY 
K a sane | WORSE OFF [ 8. poxr Know | DON ENON 


lal dion ep Om È woot 


Now turning help eee conditions in the country as a whole-~do you think 
that during the Of co 12 months we'll have | ood times financially, or bad 


times, or aaa coupe T ho ¢€ ood. Himes 
les, bub what 


GOOD TIMES | BAD WITH 


QUALIFICATIONS 


GOOD WITH 
eS | 


TURN TO P.2 
' , 
PRO-CON 8. DON'T KNOW A5 


Why dọ you think that? 


) & 
we hwe three lars gan drivers, ( RO- P 
s & whak? w re 
15 50 e on H t 


tr 


Source: Survey Research Center, Interviewer’s Manual, rev. ed. (Ann Arbor, MI: Institute for Social Research, 
University of Michigan, 1976), p. 26. Reprinted by permission. 


Terminating the Interview 


The final aspect of training is to instruct interviewers on how to close the interview. Fieldworkers 
should wait to close the interview until they have secured all pertinent information. The inter- 
viewer who departs hastily will be unable to record the spontaneous comments respondents some- 
times offer after all formal questions have been asked. Merely recording one of these comments 
may result in a new idea or creative interpretation of the results. Avoiding hasty departures is also 
a matter of courtesy. The fieldworker should also answer any respondent questions concerning the 
nature and purpose of the study to the best of his or her ability. 

Finally, it is extremely important to thank the respondent for his or her time and cooperation. 
The fieldworker may be required to reinterview the respondent at some future time. So, the respon- 
dent should be left with a positive feeling about having cooperated in a worthwhile operation. 
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Principles of Good Interviewing 


Yankelovich Partners is one of the nation’s top research organizations.’ One reason for its success 
is its careful attention to fieldwork. This section presents this organization’s principles of good 
interviewing. These principles apply no matter what the nature of the specific assignment; they 
are universal and represent the essence of sound data collection for business research purposes. For 
clarity, they have been divided into two categories: the basics (the interviewing point of view) and 
required practices (standard inquiry premises and procedures). 


The Basics 


Interviewing is a skilled occupation so not everyone can do it, and even fewer can do it extremely 
well. A good interviewer observes the following basic principles: 


1. Have integrity, and be honest. This is the cornerstone of all professional inquiry, regardless of its 
purpose. 

2. Have patience and tact. Interviewers ask for information from people they do not know. Thus, 
all the rules of human relations that apply to inquiry situations—patience, tact, and courtesy— 
apply even more to interviewing. You should at all times follow the standard business conven- 
tions that control communications and contact. 

3. Pay attention to accuracy and detail. Among the greatest interviewing “sins” are inaccuracy and 
superficiality, for the professional analyst can misunderstand, and in turn mislead, a client. A 
good rule to follow is not to record a response unless you fully understand it yourself: Probe 
for clarification and rich, full answers. Record responses verbatim: Never assume you know 
what a respondent is thinking or jump to conclusions as to what he or she might have said but 
did not. 

4. Exhibit a real interest in the inquiry at hand, but keep your own opinions to yourself. Impartiality is 
imperative—if your opinions were wanted, you would be asked, not your respondent. You 
are an asker and a recorder of other people’s opinions, not a contributor to the study data. 

5. Bea good listener. Too many interviewers talk too much, wasting time when respondents could 
be supplying more pertinent facts or opinions on the study topic. 

6. Keep the inquiry and respondents’ responses confidential. Do not discuss the studies you are doing 
with relatives, friends, or associates; it is unacceptable to both the research agency and its cli- 
ents. Above all, never quote one respondent’s opinion to another—that is the greatest violation 
of privacy. 

7. Respect others’ rights. Business research depends on people’s willingness to provide informa- 
tion. In obtaining this information, you must follow a happy medium path. Between the 
undesirable extremes of failure to get it all and unnecessary coercion, this middle road is 
one of clear explanation, friendliness, and courtesy, offered in an interested and persua- 
sive tone. Impress upon prospective respondents that their cooperation is important and 
valuable. 


Required Practices 


Here are practical rules of research inquiry that should be followed and used without exception: 


1. Complete the number of interviews according to the sampling plan assigned to you. Both are calculated 
with the utmost precision so that when assignments are returned, the study will benefit from 
having available the amount and type of information originally specified. 

2. Follow the directions provided. Remember that many other interviewers are working on the same 
study in other places. Lack of uniformity in procedure can only spell disaster for later analysis. 
Each direction has a purpose, even though it may not be completely evident to you. 

3. Make every effort to keep schedules. Schedules range from “hurry up” to “there should be plenty 
of time,” but there is always a good reason, and you should be as responsive as possible. If you 
foresee problems, call and explain. 
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4. Keep control of each interview you do. It is up to you to determine the pace of a particular inter- 
view, keeping several points in mind: 

a. There is an established average length of an interview from the time you start to talk to the 
respondent to the time you finish. It represents a guideline, but some interviews will be 
shorter and some longer. 

b. Always get the whole story from a respondent, and write it all down in the respondent’s 
own words. Also, remember to keep the interview focused on the subject at hand and 
prevent it from wandering off into unnecessary small talk. 

c. Avoid offending the respondent by being too talkative yourself. 

5. Complete the questionnaires meticulously. 

a. Follow exactly all instructions that appear directly on the questionnaire. Before you start 
interviewing, learn what these instructions direct you to do. 

b. Ask the questions from the first to the last in the exact numerical order (unless directed 
to do otherwise in some particular instances). Much thought and effort go into deter- 
mining the order of the questioning to avoid bias or to set the stage for subsequent 
questions. 

c. Ask each question exactly as it is written. The cost of doing so is lack of unifor- 
mity; the research agency would never know whether all respondents were replying 
to the same question or replying to 50 different interviewers’ interpretations of the 
question. 

d. Never leave a question blank. It will be difficult to tell whether you failed to ask it, 
whether the respondent could not answer it because of lack of knowledge or certainty, or 
whether the respondent refused to answer it for personal reasons. If none of the answer 
categories provided prove suitable, write in what the respondent said, in his or her own 
words. 

e. Use all the props provided to aid both interviewers and respondents: show cards, pictures, 
descriptions, sheets of questions for the respondents to answer themselves, and so on. 
All have a specific interview purpose. Keys to when and how to use them appear on the 
questionnaire at the point at which they are to be used. 

6. Check over each questionnaire you have completed. This is best done directly after it has been 
completed. If you find something you did wrong or omitted, correct it. Often you can call a 
respondent back, admit you missed something (or are unclear about a particular response), and 
then straighten out the difficulty. 

7. Compare your sample execution and assigned quota with the total number of questionnaires you have 
completed. Do not consider your assignment finished until you have done this. 

8. Clear up any questions with the research agency. At the start of an assignment or after you have 
begun, if you have questions for which you can find no explanatory instructions, call the 
agency to get the matter clarified. 


Fieldwork Management 


Research managers preparing for the fieldwork stage should consider the meaning of the follow- 
ing stanza from Robert Burns’s poem “To a Mouse”: 


The best laid schemes 0’ mice and men 
Gang aft a-gley; 
An’ lea’e us nought but grief and pain, 
For promis’d joy. 


The best plans of mice, men, and researchers may go astray. An excellent research plan may go 
astray if the field operations are performed incorrectly. A proper research design will eliminate 
numerous sources of error, but careful execution of the fieldwork is necessary to produce results 
without substantial error. For these reasons fieldwork management is an essential part of the 
research process. 
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Managers of field operations select, train, supervise, and control fieldworkers. Our discussion 
of fieldwork principles mentioned selection and training. This section investigates the tasks of the 
fieldwork managers in greater detail. 


Briefing Session for Experienced Interviewers 


Whether interviewers have just completed their training in fundamentals or are already experienced, 
they always need to be informed about the individual project. Both experienced and inexperienced 
fieldworkers must be briefed on the background of the sponsoring organization, sampling tech- 
niques, asking of questions, callback procedures, and other matters specific to the particular project. 

If there are any special instructions—for example, about using show cards or video equip- 
ment or restricted interviewing times—they should also be covered during the training session. 
Instructions for handling certain key questions are always important. For example, the following 
fieldworker instructions appeared in a survey of institutional investors who make buy-and-sell 
decisions about stocks for banks, pension funds, and so on: 


Questions 13a, 13b 


These questions will provide verbatim comments for the report to the client. Probe for more than one- or 
two-word answers and record verbatim. Particularly, probe for more information when respondent gives a 
general answer—e.g., “Poor management,” “It’s in a good industry.” Ask, “In what ways is manage- 
ment poor?” “What’s good about the industry?” And so on. 


A training session for experienced interviewers might go something like this: All interviewers 
report to the central office, where they receive a brief explanation of the firm’s background and 
the general aims of the study. Interviewers are provided with minimal information about the pur- 
pose of the study to ensure that they will not transmit any preconceived notions to respondents. 
For example, in a survey about the banks in a community, the interviewers would be told that 
the research is a banking study but not the name of the sponsoring bank. To train the interview- 
ers about the questionnaire, a field supervisor conducts an interview with another field supervisor 
who acts as a respondent. The trainees observe the interviewing process, after which they each 
interview and record the responses of another field supervisor who acts as a respondent. After the 
practice interview, the trainees receive additional instructions. 


Training to Avoid Procedural Errors in Sample Selection 


The briefing session also covers the sampling procedure. A number of research projects allow the 
interviewer to be at least partially responsible for selecting the sample. These sampling methods 
offer the potential for selection bias. This potential for bias is obvious in the case of quota sampling 
but less obvious in other cases. For example, in probability sampling in which every nth house is 
selected, the fieldworker uses his or her discretion in identifying housing units. Avoiding selection 
bias may be more difficult than it sounds. For example, in an old, exclusive neighborhood, a man- 
sion’s coach house or servants’ quarters may have been converted into an apartment that should 
be identified as a housing unit. This type of dwelling and other unusual housing units (apartments 
with alley entrances only, lake cottages, or rooming houses) may be overlooked, giving rise to 
selection error. Errors may also occur in the selection of random-digit dialing samples. Consider- 
able effort should be expended in training and supervisory control to minimize these errors. 
Another selection problem is the practice of contacting a respondent when and where it is con- 
venient for both parties. Consider the following anecdote from an industrial research interviewer: 


Occasionally getting to the interview is half the challenge and tests the interviewer’s ingenuity. Finding 
your way around a huge steel mill is not easy. Even worse is trying to find a correct turn-off to gravel pit 
D when it’s snowing so hard that most direction signs are obliterated. In arranging an appointment with 
an executive at a rock quarry outside Kansas City, he told me his office was in “Cave Number 3.” It was 
no joke. To my surprise, I found a luxurious executive office in a cave, which had long ago been hollowed 
by digging for raw material.® 


In that case, finding the sample unit was half the battle. 
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A Total Quality Management 
= ' for Interviewing 
Interviewers and their supervisors can 
improve the process of data collection to minimize 
errors. One popular method, total quality manage- 
ment (TQM), seeks continuous improvement by getting everyone 
involved in measuring performance and looking for ways to 
improve processes: 


+ Measure response rates, and improve interviewer training to 


may signal respondent behaviors with a potential to bias 
responses from certain segments. 

Measure the interview process, including the training pro- 
vided, the application of principles from training, and feed- 
back about the interviewer. The training should be aimed at 
specific, measurable objectives, with a plan for measuring 
whether the interviewers’ performance shows that training 
objectives were met. For a standardized interview, one way 
to tell whether the interviews are following the guidelines 
is to measure whether they all last about the same amount 


improve response rates. To do this, researchers must describe 
the procedure for contacting subjects and consider alterna- 


rovides insight into the 
tives, such as letters of introduction, the timing of contacts, E 5 


of time. Verification by reinterviewing a subsample 


accuracy of recording 
responses. Where vari- 
ances occur, the super- 
visor and interviewers 
should investigate the 
cause, looking for ways 
to improve training and 
interviewing. 


and the number of attempts to make before a subject is 
classified as a nonrespondent. Interviewers should be taught 
about the impact on research quality of interviewing only the 
people who are easiest to contact, and they should be trained 
to persuade people to participate. 

+ Measure defects in terms of measurement errors and improve 
interviewer techniques and respondent behavior. Researchers 
should measure the pattern of response rates by interviewer, 
looking for interviewer variance (a tendency for different Source Baced oniLaowueldee GeCrC ABR 
interviewers to obtain different answers). To measure respon- Carton, and Jaak Billiet, “Assessment 
dent behavior, researchers can ask interviewers for objective of Survey Data Quality: A Pragmatic 
information such as the presence of a third person, as well ApproachFocused oninterviewer 


, ‘ ? Tasks,’ International Journal of Market 
as for an evaluation of each interview’s success; the data Research (Spring 2004), pp. 65-82) 


Supervision of Fieldworkers 


Although briefing and training interviewers will minimize the probability of their interviewing 
the wrong households or asking biased questions, there is still considerable potential for errors 
in the field. Direct supervision of personal interviewers, telephone interviewers, and other field- 
workers is necessary to ensure that the techniques communicated in the training sessions are 
implemented in the field. 

Supervision of interviewers, like other forms of supervision, refers to controlling the efforts of 
workers. Field supervision of interviewers requires checking to see that field procedures are being 
properly followed. A supervisor checks field operations to ensure that the interviewing schedule 
is being met. Supervisors collect the questionnaires or other instruments daily and edit them for 
completeness and legibility. (See Chapter 19 for more details on editing.) If problems arise, super- 
visors discuss them with the fieldworkers, providing training when necessary. 

As seen in the Research Snapshot above, the importance of quality control cannot be under- 
estimated. In addition to quality control, continual training may be provided. For example, if a 
telephone supervisor notices that interviewers are allowing the phone to ring more than eight 
times before considering the call a “no answer,” the supervisor can instruct interviewers not to do 
so, as the person who eventually answers is likely to be annoyed. 


Sampling Verification 


Another important job of a supervisor is to verify that interviews are being conducted according 
to the sampling plan rather than with the sampling units most accessible to the interviewer. An 
interviewer might be tempted to go to the household next door for an interview rather than 


455 


© IMAGE 100/JUPITER IMAGES 


456 


interviewer cheating 


The practice by fieldworkers 
of filling in fake answers or 
falsifying interviews. 


curb-stoning 


A form of interviewer cheating 
in which an interviewer makes 
up the responses instead of 
conducting an actual interview. 
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record the sampling unit as not at home, which would require a callback. Carefully recording 
the number of completed interviews will help ensure that the sampling procedure is being prop- 
erly conducted. Supervisors are responsible for motivating interviewers to follow the sampling 
plan carefully. 

Closer supervision of the interviewing procedure can occur in central-location telephone 
interviewing. Supervisors may be able to listen to the actual interview by switching onto 
the interviewer’s line. Of course, this is harder to do when interviewers call from their own 
homes. 

Supervisors must also make sure that the right people within the household or sampling unit 
are being contacted. One research project for a children’s cereal required that several products 
be placed in the home and that children record their daily consumption and reactions to each 
cereal in a diary. Although the interviewers were supposed to contact the children to remind 
them to fill out the diaries, a field supervisor observed that in almost half the cases the mothers 
were filling out the diaries after the children left for school because their children had not done 
so. The novelty of the research project had worn off after a few days; eating a specific cereal each 
day was no longer fun after the first few times, and the children had stopped keeping the diaries. 
Similar situations may occur with physicians, executives, and other busy people. The interviewer 
may find it easier to interview a nurse, secretary, or other assistant rather than wait to speak with 
the right person. 


Interviewer Cheating 


The most blatant form of interviewer cheating occurs when an interviewer falsifies interviews, 
merely filling in fake answers rather than contacting respondents. This is sometimes referred to as 
curb-stoning. Although this situation does occur, it is not common if the job of selection has been 
properly accomplished. However, less obvious forms of interviewer cheating occur with greater 
frequency. Interviewers often consider quota sampling to be time consuming, so an interviewer 
may stretch the requirements a bit to obtain seemingly qualified respondents. In the interviewer’s 
eyes, a young-looking 36-year-old may be the same as a 30-year-old who fits the quota require- 
ment; checking off the under-30 category thus isn’t really cheating. Consider the fieldworker who 
must select only heavy users of a certain brand of hand lotion that the client says is used by 
15 percent of the population. If the fieldworker finds that only 3 percent qualify as heavy users, he 
or she may be tempted to interview an occasional user to stretch the quota somewhat. All of these 
approaches are unethical. 

An interviewer may fake part of a questionnaire to make it acceptable to the field supervisor. 
In a survey on automobile satellite radio systems, suppose an interviewer is requested to ask for 
five reasons why consumers have purchased this product. If he or she finds that people typically 
give two or perhaps three reasons and even with extensive probing cannot think of five reasons, 
the interviewer might be tempted to cheat. Rather than have the supervisor think he or she was 
goofing off on the probing, the interviewer may fill in five reasons based on past interviews. In 
other cases, the interviewer may cut corners to save time and energy. 

Interviewers may fake answers when they find questions embarrassing or troublesome to 
ask because of sensitive subjects. Thus, the interviewer may complete most of the questionnaire 
but leave out a question or two because he or she found it troublesome or time-consuming. 
For example, in a survey among physicians, an interviewer might find questions about artificial- 
insemination donor programs embarrassing, skip these questions, and fill in the gaps later. 

What appears to be interviewer cheating often is caused by improper training or fieldworkers’ 
inexperience. A fieldworker who does not understand the instructions may skip or miss a portion 
of the questionnaire. 

Interviewers may be reluctant to interview sampling units who they feel may be difficult or 
undesirable to interview. Sometimes fieldworkers are instructed to say at the conclusion of each 
interview, “Thank you for your time—and by the way, my supervisor may call you to ask about 
my work. Please say whatever you wish.” This or a similar statement not only increases the num- 
ber of respondents willing to cooperate with the verification process but also improves the quality 
of fieldwork. 


A 
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e  Fieldworkers are a potential sourceof |e Avoid incentives that strongly encourage (coerce) fieldwork- 


E error in gathering information. Investing ers to submit a large amount of completed interviews. This 
z resources into making sure fieldworkers are motivates the fieldworkers to be sloppy or dishonest. 

š competent in carrying out their assigned tasks is e Unusual responses need to be followed up with probing 

~ money and time well spent. questions that attempt to verify the initial response. 

3 e — Fieldworkers should wear name badges and/or e Respondents in online panels or chat rooms should rou- 
5 clearly introduce themselves and their employer (the research tinely be asked follow-up questions for the purpose of 
o firm) to the potential respondent. validating the reported behavior. 


Verification by Reinterviewing 


Supervision for quality control attempts to ensure that interviewers are following the sampling pro- 
cedure and to detect falsification of interviews. Supervisors verify approximately 15 percent of the 
interviews by reinterviewing. Normally the interview is not repeated; rather, supervisors recontact 
respondents and ask about the length of the interview and their reactions to the interviewer; then 
they collect basic demographic data to check for interviewer cheating. Such verification does not verification 


detect the more subtle form of cheating in which only portions of the interview have been falsified. Quality-control procedures in 
A validation check may simply point out that an interviewer contacted the proper household but fieldwork intended to ensure 
that interviewers are following 
the sampling procedures and to 


PE i f . ain : ‘ determine whether interviewers 
be a telephone or postcard validation check often reminds interviewers to be conscientious in their are cheating. 


interviewed the wrong individual in that household—which, of course, can be a serious error. 
Fieldworkers should be aware of supervisory verification practices. Knowing that there may 


work. The interviewer who is conducting quota sampling and needs an upper-income Hispanic 
male will be less tempted to interview a middle-income Hispanic man and falsify the income data 
in this situation. 

Certain information may allow for partial verification without recontacting the respon- 
dent. Computer-assisted telephone interviewers often do not know the phone number dialed 
by the computer or other basic information about the respondent. Thus, answers to ques- 
tions added to the end of the telephone interview to identify a respondent’s area code, phone 
number, city, zip code, and so on may be used to verify the interview. The computer can also 
record every attempted call, the time intervals between calls, and the time required to conduct 
each completed interview—data that may help in identifying patterns related to cheating by 
interviewers. 


Summary 


1. Describe the role and job requirements of fieldworkers. Fieldworkers are responsible for gath- 
ering data in the field. These activities may be performed by the organization that needs the 
information, by research suppliers, or by third-party field service organizations. Proper execution 
of fieldwork is essential to produce research results without substantial error. Proper control of 
fieldwork begins with interviewer selection. Fieldworkers generally should be healthy, outgoing, 
and well groomed. 


2. Summarize the skills to cover when training inexperienced interviewers. New fieldworkers 
must be trained in opening the interview, asking the questions, probing for additional informa- 
tion, recording the responses, and terminating the interview. 


3. List principles of good interviewing. Good interviewers have integrity, patience, and tact. 
They are attentive to detail and interested in the inquiry at hand. They behave impartially, listen 
carefully, and maintain confidentiality. They respect the rights of others. Interviewing should 
adhere to several required practices. Interviewers should complete all interviews according to the 
sample plan and follow the directions provided. They should try to meet schedules and main- 
tain control of the interview. They should fill in answers meticulously and then check over the 
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questionnaire to make sure it is complete. Before finishing an assignment, they should verify that 
the number of completed questionnaires matches the sampling plan and assigned quotas. If they 
have questions, they should check with the agency conducting the research. 


4. Describe the activities involved in the management of fieldworkers. Experienced fieldworkers 
are briefed for each new project to familiarize them with its specific requirements. A particular 
concern of the briefing session is reminding fieldworkers to adhere closely to the prescribed 
sampling procedures. 


5. Discuss how supervisors can minimize errors in the field. Careful supervision of fieldworkers 
also is necessary. Supervisors gather and edit questionnaires each day. They check to see that field 
procedures are being properly followed and that interviews are on schedule. They also check to 
ensure that the correct sampling units are being used and that the proper people are respond- 
ing in the study. Finally, supervisors check for interviewer cheating and verify portions of the 
interviews by reinterviewing a certain percentage of each fieldworker’s respondents. 


Key Terms and Concepts 


briefing session, 445 field interviewing service, 444 in-house interviewer, 444 
curb-stoning, 456 fieldworker, 444 interviewer cheating, 456 
door-in-the-face compliance technique, 447 — foot-in-the-door compliance technique, 447 verification, 457 


Questions for Review and Critical Thinking 


1. What qualities should fieldworkers possess? “Would you please read the instructions on this card and then 
2. ETHICS An interviewer has a rather long telephone interview. open this can for me?” (Interviewer: Note any comments respon- 
The estimate suggests that fully completing the survey will take dent makes. Do not under any circumstances help him or her to open 
30 minutes. However, what do you think the response rate will the can or offer any explanation as to how to open it. If respondent 
be if people are told ahead of time that it will take 30 minutes asks for help, tell him that the instructions are on the card. Do not 
to finish participating in the survey? Should the interviewer discuss the can or its contents.) 
fudge a little and state that the survey will take only 15 minutes? 


c. A researcher gives balloons to children of respondents to 

keep the children occupied during the interview. 

An interviewer tells the supervisor, “With the price of gas, 

this job isn’t paying as well as before!” 

e. When a respondent asks how much time the survey will 
take, the interviewer responds, “15 to 20 minutes.” The 


Explain. 
3. What should the interviewer do if a question is misunderstood? 


oa 


If a respondent answers a question before encountering it in the 
questionnaire? 

4. When should interviewers probe? Give some examples of how 

probing should be done. Bees Bee 

‘ : respondent says, “I’m sorry, I have to refuse. I can’t give 

5. How should respondents’ answers to open-ended questions be P y ies = 


ou that much time right now.” 
recorded? y 5 


11. Write some interviewer instructions for a telephone survey. 


6. How should the fieldworker terminate the interview? 
E Co E OE 12. A fieldworker conducting a political poll is instructed to 


7. Why is it important to ensure that fieldworkers adhere to the 


; ; : interview registered voters. The fieldworker interviews all 
sampling procedure specified for a project? 


8. ETHICS What forms does interviewer cheating take? How can willing participants we Pere bis ner who niay 
register in the future) because allowing their opinions to be 
recorded is part of her patriotic duty. Is she doing the right 
thing? 

13. An interviewer finds that when potential respondents ask how 
much time the survey will take, most refuse if they are told 
15 minutes. The interviewer now says 10 minutes and finds 


such cheating be prevented or detected? 
9. ETHICS Two interviewers are accused of curb-stoning. What 
have they done? 
10. Comment on the following field situations. 
a. After conducting a survey with 10 people, an interviewer 
noticed that many of the respondents were saying “Was I 


; f i that most respondents enjoy answering the questions. Is this 
right?” after a particular question. P yoy 8 a 


the right thing to do? 


b. A ti ire asking about - i h 
EA ET E O 14. A fieldworker asks respondents whether they will answer a few 


the following instructions to interviewers: : . : 
questions. However, the interviewer also observes the respon- 


(Hand respondent can and matching instruction card.) dent’s race and approximate age. Is this ethical? 


Chapter 18: Fieldwork 
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Research Activity 


1. ‘NET Go to http://www.quirks.com/directory/telephone/ 
index.aspx. Using the search window, investigate the following. 
Suppose you were interested in conducting telephone 
interviews in a number of places. List telephone facilities in 


Denmark, Mexico, South Korea, and Alabama (United States). 
Is CATI available in every county of Alabama? 


Case 18.1 Thomas and Dorothy Leavey Library 


The Thomas and Dorothy Leavey Library serves 
the students and faculty of the University of 
Southern California. Staff at the busy library 
wanted to know more about its patrons, what 
library resources they find helpful, and whether 
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they are satisfied with the library’s services. 
However, like many libraries, this organization had a tiny budget 
for business research. As a result, the goal was to conduct explor- 
atory research while spending less than $250.” 

Staff members studied surveys conducted by other libraries to 
get ideas for a one-page printed questionnaire. Colleagues on the 
library staff provided suggestions, and a few undergraduates tested 
the survey for clarity. Next, the survey schedule was chosen: 36 
continuous hours that did not conflict with any holidays or exams. 

The fieldwork involved setting up and staffing a table offer- 
ing the survey and then inviting library patrons to stop and fill out 
a questionnaire. Possible locations included space near an eleva- 
tor, stairs, or computers, but the lobby area offered the greatest 


opportunity, because everyone passed through the lobby when 
using the facility’s only entrance. The survey’s planners divided 
the time into 60 slots and recruited students with jobs at the 
library to serve as the fieldworkers. Other members of the library 
staff also volunteered to fill time slots. The students in particular 
were enthusiastic about inviting library patrons to complete 
questionnaires. A bowl of candy for participants was a small 
incentive, combined with a raffle for donated prizes. 


Questions 

1. Imagine that you were asked to help prepare for this survey. 
What fieldwork challenges would you expect to arise in a 
survey such as this, to be carried out by inexperienced 
fieldworkers? 

2. What training would you recommend for the students and 
other library staffers conducting this survey? Suggest topics to 
cover and advice to give these fieldworkers. 


Case 18.2 Margaret Murphy O’Hara 


Margaret Murphy O’Hara was fatigued. As she 
wiped the perspiration from her brow, she felt 
that the Massachusetts summer sun was playing a 
trick on her. It was her first day at work, and the 
weather was hot. She had no idea that being a 


© GETTY IMAGES/ 
PHOTODISC GREEN 


| field interviewer required so much stamina. Even 
though she was tired, she was happy with her new job. She didn’t 
yet have the knack of holding her purse, questionnaires, and clip- 
board while administering the show cards, but she knew she’d get 
the hang of it. The balancing act can be learned, she thought. 

When she met her supervisor, Mary Zagorski, at the end of her 
first day, Margaret described her day. Margaret said she thought the 
questionnaire was a bit too long. She laughed, saying that an elderly 
lady had fallen asleep after about 20 minutes of interviewing. 

Margaret mentioned that a number of people had asked why 
they were selected. Margaret said she did not know exactly what to 
say when somebody asked, “Why did you pick me?” 

She said that the nicest person she had interviewed was a man 
whose wife wasn’t home to be surveyed. He was very friendly and 
didn’t balk at being asked about his income and age like some of 
the other people she had interviewed. 


She said she had one problem that she needed some help 
with resolving. Four or five people refused to grant the interview. 
Margaret explained that one woman answered the door and said 
she was too busy because her son, an army private, was leaving the 
country. The woman was throwing a little party for him before he 
went off to the airport. Margaret didn’t want to spoil their fun with 
the survey. Another lady said that she was too busy and really didn’t 
know anything about the subject anyway. However, she did suggest 
her next-door neighbor, who was very interested in the subject. 
Margaret was able to interview this person to make up for the lost 
interview. It actually went quite well. 

Margaret said another woman wouldn't be interviewed because 
she didn’t know anything about the Zagorski interviewing ser- 
vice, and Margaret didn’t know quite what to tell her. Finally, she 
couldn’t make one interview because she didn’t understand the 
address: 9615 South Francisco Rear. Margaret told Mary it was 
quite a day, and she looked forward to tomorrow. 


Questions 
1. Is Margaret going to be a good professional interviewer? 
2. What should Mary Zagorski tell Margaret? 


CHAPTER 19 
EDITING AND 
CODING: 
TRANSFORMING 
AG studying this chapter, you should be able to RAW DATA INTO 


. Know when a response is really an error and should 


fone INFORMATION 
2. Appreciate coding of pure qualitative research 


. Understand the way data are represented in a data file 


4. Understand the coding of structured responses including 
a dummy variable approach 


5. Appreciate the ways that technological advances have 
simplified the coding process 


w 


Chapter Vignette: Coding What a Person’s Face “Says” 


Understanding what respondents say, or coding the data gathered from a survey represents 
a challenge that all business researchers face. But technological advances have 
now allowed business researchers a chance to collect and code 

data not based upon what people say, but what their face “says.” 
Welcome to the new world of Sensory Logic, and the Tobii Eye 
Tracker and Studio. 

Body language is a key way that people communicate their 
thoughts and emotional states. Researchers have long known the 
power of non-verbal cues and response states, and have sought to 
understand and capture how non-verbal communication unfolds. 
Sensor Logic’s Tobii system is one example of how research in 
eye movement and facial coding has advanced to a point where 
respondent physical data can be captured in real time for research 
purposes. Facial coding reveals a person’s engagement, their posi- 
tive and negative emotional states given a particular stimuli, and the 
impact or appeal of what they are responding to. Eye tracking can tell 
researchers exactly what a person is looking at, and based upon the 
almost imperceptible muscle changes in their facial expressions, code 
their emotional state. 

The Tobii system is used in a number of consumer and market 
research environments. For example, a company may develop a Web 
page designed to showcase their product line. Using the Tobii system, 
focus group members can have their nonverbal responses and eye 
tracking analyzed, to see which aspects of the product are being exam- 
ined, and what immediate emotional response is generated. The objec- 
tive data can then be paired with other data, and analyzed for business 
purposes. 

In the future, the ability to capture and code physical data will become 
more and more commonplace. Perhaps you too will have a chance to par- 
ticipate in a product or service research study using the Tobii system, and 
be given an opportunity to “speak” without ever saying a word.’ 

This chapter deals with coding and editing raw data. Researchers must pay careful 
attention to their coding because poor coding leads directly to nonresponse error. 
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raw data 


The unedited responses from a 
respondent exactly as indicated 
by that respondent. 


nonrespondent error 


Error that the respondent is not 
responsible for creating, such as 
when the interviewer marks a 
response incorrectly. 


EXHIBIT 19.1 
Overview of the Stages of 
Data Analysis 


Part 6: Data Analysis and Presentation 


Introduction 


A very common phrase that is used by researchers is “garbage in, garbage out.” This refers to the 
idea that if data is collected improperly, or coded incorrectly, your results are “garbage,” because 
that is what was entered into the data set to begin with. This chapter focuses on the critical key 
step of data entry and coding. Like any part of the business research process, care and attention to 
detail are important requirements for data editing and coding. 


Stages of Data Analysis 


Practically all researchers will be very anxious to begin data analysis once the field work is com- 
plete. Now, the raw data can be transformed into intelligence. However, raw data may not be in 
a form that lends itself well to analysis. Raw data are recorded just as the respondent indicated. 
For an oral response, the raw data are in the words of the respondent, whereas for a questionnaire 
response, the actual number checked is the number stored. Raw data will often also contain errors 
both in the form of respondent errors and nonrespondent errors. Whereas a respondent error is a 
mistake made by the respondent, a nonrespondent error is a mistake made by an interviewer or by 
a person responsible for creating an electronic data file representing the responses. 

Exhibit 19.1 provides an overview of data analysis. The first two stages result in an electronic 
file suitable for data analysis. This file can then be used in the application of various statistical 
routines including those associated with descriptive, univariate, bivariate, or multivariate analysis. 
Each of these data analysis approaches will be discussed in the subsequent chapters. An important 
part of the editing, coding, and filing stages is checking for errors. As long as error remains in the 
data, the process of transformation from raw data to intelligence will be made more risky and more 
difficult. Editing and coding are the first two stages in the data analysis process. 


Raw Data 


Error Checking 
Takes Place in 
Each of These 
Stages 


Intelligence 


Source: Survey and Opinion Research: Procedures for Processing and Analysis, Sonquist, J.A. & Dunkelberg, W.C. 
(1977). Englewood Cliffs, NJ: Prentice-Hall. Reprinted by permission of Pearson Education, Inc., Upper Saddle 
River, NJ. 
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ji 7 The Survey This! feature can 
$ help in understanding data cod- 

A V ing and basic analyses. How are 

Y data entry, editing, and coding 
made easier using a Qualtrics-type 
data approach relative to a paper and 

pencil survey approach? Do any questions 
in the survey present particular coding issues that are 
not fully addressed automatically by Qualtrics software? 
Are there any variables which would best be coded as 
dummy variables? What are they? What type of coding 


would you suggest for the question about your boss and 
animals shown here? 


acmties 


concern for your health ° (e) (0) © © 12) 

your personal development (0) fo} [0] © © oO 

your performance in school © ° © © © © 

your social life © [0] (0) (0) Lo} (9) 
_— E a 
[Done @ internet Rioo%  ~ 


Data integrity refers to the notion that the data file actually contains the information that 
the researcher promised the decision maker he or she would obtain. Additionally, data integrity 
extends to the fact that the data have been edited and properly coded so that they are useful to the 
decision maker. Any errors in this process, just as with errors or shortcuts in the interview process 
itself, harm the integrity of the data. 


Editing 


Fieldwork often produces data containing mistakes. For example, consider the following simple 
questionnaire item and response: 


How long have you lived at your current address? 48 


The researcher had intended the response to be in years. Perhaps the respondent has indicated the 
number of months rather than years he or she has lived at this address? Alternatively, if this was an 
interviewer’s form, he or she may have marked the response in months without indicating this on 
the form. How should this be treated? Sometimes, responses may be contradictory. What if the 
same respondent above gives this response? 


What is your age? 32 years 


This answer contradicts the earlier response. If the respondent is 32 years of age, then how could 
he or she have lived at the same address for 48 years? Therefore, an adjustment should be made to 
accommodate this information. The most likely case is that this respondent has lived at the current 
address for four years. 

This example illustrates data editing. Editing is the process of checking and adjusting data for 
omissions, consistency, and legibility. In this way, the data become ready for analysis by a com- 
puter. So, the editor’s task is to check for errors and omissions on questionnaires or other data 
collection forms. When the editor discovers a problem, he or she adjusts the data to make them 
more complete, consistent, or readable. 

At times, the editor may need to reconstruct data. In the example above, the researcher can 
guess with some certainty that the respondent entered the original questions in months instead of 
years. Therefore, the probable true answer can be reconstructed. While the editor should try to 


data integrity 


The notion that the data file 
actually contains the information 
that the researcher promised the 
decision maker he or she would 
obtain, meaning in part that the 
data have been edited and prop- 
erly coded so that they are useful 
to the decision maker. 


editing 


The process of checking the 
completeness, consistency, and 
legibility of data and making the 
data ready for coding and trans- 
fer to storage. 
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Field edits allow supervisors to 
spot errors before the data file 
is created. 


field editing 

Preliminary editing by a field 
supervisor on the same day as 
the interview to catch techni- 
cal omissions, check legibility 
of handwriting, and clarify 
responses that are logically or 
conceptually inconsistent. 


in-house editing 


A rigorous editing job performed 
by a centralized office staff. 


common Way. 


—Booker T. Washington 
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make adjustments in an effort to represent as much information from a 
respondent as possible, reconstructing responses in this fashion should 
be done only when the probable true response is very obvious. Had 
the respondent’s age been 55 years, filling in the response with years 
would not have been advisable barring other information. Perhaps the 
respondent has lived in the house since childhood? That possibility 
would seem real enough to prevent changing the response. 


a 


Field Editing 


Field supervisors often are responsible for conducting preliminary field 
editing on the same day as the interview. Field editing is used to 


1. Identify technical omissions such as a blank page on an interview 
form 

2. Check legibility of handwriting for open-ended responses 

3. Clarify responses that are logically or conceptually inconsistent. 


Field editing is particularly useful when personal interviews have 
been used to gather data. In these cases, a daily field edit allows 
supervisors to deal with some questions by asking interviewers, who 
may still be able to remember the interviews, about facts that may 
allow errors to be identified and perhaps corrected. In addition, the 
number of unanswered questions or incomplete responses can be 
reduced with rapid follow up. A daily field edit allows fieldworkers 
to identify respondents who should be recontacted to fill in omis- 
sions in a timely fashion. 

The supervisor may also use field edits to spot the need for further interviewer training or to 
correct faulty procedures. For example, if an interviewer did not correctly follow skip patterns, 
training may be indicated. The supervisor may also notice that an interviewer is not properly 
probing some open-ended responses. 


In-House Editing 


Although simultaneous field editing is highly desirable, in many situations (particularly with mail 
questionnaires) early reviewing of the data is not always possible. In-house editing rigorously inves- 
tigates the results of data collection. The research supplier or research department normally has a 
centralized office staff perform the editing and coding function. 

For example, Arbitron measures radio audiences by having respondents record their listening 
behavior—time, station, and place (home or car)—in diaries. After the diaries are returned by 
mail, in-house editors perform usability edits in which they check that the postmark is after the 
last day of the survey week, verify the legibility of station call letters (station WKXY could look 
like KWXY), look for completeness of entries on each day of the week, and perform other edit- 
ing activities. If the respondent’s age or sex is not indicated, the respondent is called to ensure that 
this information is included. 


ILLUSTRATING INCONSISTENCY—FACT OR FICTION? 


Consider a situation in which a telephone interviewer has been instructed to interview only reg- 
istered voters in a state that requires voters to be at least 18 years old. If the editor’s review of a 
questionnaire indicates that the respondent was only 17 years old, the editor’s task is to correct 
this mistake by deleting this response because this respondent should never have been considered 
as a sampling unit. The sampling units (respondents) should all be consistent with the defined 
population. 
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A Do You Have Integrity? 
-Data integrity is essential to success- 
ful research and decision making. 
Sometimes, this is a question of ethics. Whereas 
data integrity can suffer when an interviewer or 
coder simply makes up data, other things can occur that limit 
data integrity. For instance, data with a large portion of nonre- 
sponse has lower integrity than data without so much missing 
data. However, if respondents have truly left questions blank, the 
editor should not feel compelled to just “make up” responses. 
Data integrity can also suffer simply because the data are 

edited or coded poorly. For example, the data coder should 
be aware that data may be used by other downstream users. 
Therefore, consistent coding should exist. For example, if a coder 
sometimes uses 1 for women and 2 for men, while on another 
data set uses 0 for men and 1 for women, the possibility exists 
that analyses using these categories will be confused. Who 
exactly are the men and who are the women? This is particularly 
true if the coder does not enter value labels for the variable. 


Consider how important consistent coding is for companies 
that share or sell secondary data. Occupations need a common 
coding just as do product classes, industries, and numerous other 
potential data values. Fortunately, industries have standard codes 
such as NAICS (North American Industrial Classification System) and 
SIC (Standardized Industrial Classification) codes. Some professional 
coders have adopted postal service guidelines for coding things 
like states and addresses. A search of the U.S. Post Office Web site 
should come to a page with these guidelines (http://pe.usps.gov). 
Without a standardized approach, analysts may never be quite 
sure what they are looking at from one data set to another. Thus, 
research firms need to carefully 


maintain information coding 
systems that help maximize 
data integrity. 


Sources: Dubberly, Hugh, “The 
Information Loop,” ClOlnsight 43 
(September 2004), 55-61; Shonerd, 
René, “Data Integrity Rules,” Association 
Management 55, no. 9 (2003), 14. 


The editor also should check for consistency within the data collection framework. For exam- 


ple, a survey on out-shopping behavior (shopping in towns other than the one in which the per- 


son resides) might have a question such as the following: 


In which of the following cities have you shopped for clothing during the last year? 


e = San Francisco 
e Sacramento 

e San José 

e Los Angeles 
e Other 


Please list the clothing stores where you have shopped during the last two months. 


Suppose a respondent checks Sacramento and San Francisco to the first question. If the same 


respondent lists a store that has a location only in Los Angeles in the second question, an error is 


indicated. Either the respondent failed to list Los Angeles in the first question or listed an errone- 


ous store in the second question. These answers are obviously inconsistent. 


TAKING ACTION WHEN RESPONSE IS OBVIOUSLY AN ERROR 


What should the editor do? If solid evidence exists that points to the fact that the respondent simply 
failed to check Los Angeles, then the response to the first question can be changed to indicate that 


the person shopped in that city as well. Since Los Angeles is not listed next to Sacramento or San 


Francisco, it is unlikely that the respondent checked the wrong city inadvertently. Perhaps the ques- 


tion about the stores triggered a memory that did not come to the respondent when checking off 


the cities. This seems quite possible, and if another question can also point strongly to the fact that 


the respondent actually shopped at the store in Los Angeles, then the change should be made. 


However, perhaps the respondent placed a mail order with the store in Los Angeles and simply 


did not physically shop in the store. If other evidence suggests this possibility, then the researcher 


should not make an adjustment to the first question. For example, a later question may have the 


respondent list any clothing orders placed via mail order (or by telephone or Internet order). 
Responses should be logically consistent, but the researcher should not jump to the con- 


clusion that a change should be made at the first site of an inconsistency. In all but the most 
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item nonresponse 


The technical term for an unan- 
swered question on an otherwise 
complete questionnaire resulting 

in missing data. 


plug value 


An answer that an editor “plugs 
in” to replace blanks or missing 
values so as to permit data analy- 
sis; choice of value is based on a 
predetermined decision rule. 


impute 


To fill in a missing data point 
through the use of a statistical 
algorithm that provides a best 
guess for the missing response 

based on available information. 
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obvious situations, a change should only be made when multiple pieces of evidence exist that 
some response is in error and when the likely true response is obvious. 

Many surveys use filter or “skip” questions that direct a respondent to a specific set of ques- 
tions depending on how the filter question is answered according to the respondent’s answers. 
Common filter questions involve age, sex, home ownership, or product usage. A survey might 
involve different questions for a home owner than for someone who does not own a home. A 
data record may sometimes contain data on variables that the respondent should never have been 
asked. For example, if someone indicated that he or she did not own a home, yet responses for 
the home questions are provided, a problem is indicated. The editor may check other responses 
to make sure that the screening question was answered accurately. For instance, if the respondent 
left the question about home value unanswered, then the editor will be confident that the person 
truly does not own a home. In cases like this, the editor should adjust these answers by considering 
all answers to the irrelevant questions as “no response” or “not applicable.” 


EDITING TECHNOLOGY 


Today, computer routines can check for inconsistencies automatically. Thus, for electronic ques- 
tionnaires, rules can be entered which prevent inconsistent responses from ever being stored in the 
file used for data analysis. These rules should represent the conservative judgment of a trained data 
analyst. Some online survey services can assist in providing this service. In fact, the rules can even 
be preprogrammed to prevent many inconsistent responses. Thus, if a person who is 25 indicates 
that he or she has lived in the same house for 48 years, a pop-up window can appear requiring 
the respondent to go back and fix an earlier incorrect response. Electronic questionnaires can also 
prevent a respondent from being directed to the wrong set of questions based on a screening ques- 
tion response. 


Editing for Completeness 


In some cases the respondent may have answered only the second portion of a two-part question. 
The following question creates a situation in which an in-house editor may have to adjust answers 
for completeness: 


Does your organization have more than one computer network server? 


Yes No 


If yes, how many? 


If the respondent checked neither yes nor no but indicated three computer installations, the editor 
should change the first response to a “Yes” as long as other information doesn’t indicate otherwise. 
Here again, a computerized questionnaire may either not allow a response to the “how many” 
question if someone checked yes or require the respondent to go back to the previous question 
once he or she tries to enter a number for the “how many” question. 

Item nonresponse is the technical term for an unanswered question on an otherwise complete 
questionnaire. Missing data results from item nonresponse. Specific decision rules for handling this 
problem should be meticulously outlined in the editor’s instructions. In many situations the decision 
rule is to do nothing with the missing data and simply leave the item blank. However, when the 
relationship between two questions is important, such as that between a question about job satisfac- 
tion and one’s pay, the editor may be tempted to insert a plug value. The decision rule may be to 
plug in an average or neutral value in each instance of missing data. Several choices are available: 


1. Leave the response blank. Because the question is so important, the risk of creating error by 
plugging a value is too great. 

2. Plug in alternate choices for missing data (“yes” the first time, “no” the second time, “yes” the 
third time, and so forth). 

3. Randomly select an answer. The editor may flip a coin with heads for “yes” and tails for “no.” 

4. The editor can impute a missing value based on the respondent’s choices to other questions. 
Many different techniques exist for imputing data. Some involve complex statistical estimation 
approaches that use the available information to forecast a best guess for the missing response.* 
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This issue used to be a bigger concern when many statistical software programs required com- 
plete data for an analysis to take place. Other routines may require that an entire sampling unit 
be eliminated from analysis if even a single response is missing (list-wise deletion). Today, most 
statistical programs can accommodate an occasional missing response through the use of pair-wise 
deletion. Pair-wise deletion means the data that the respondent did provide can still be used in sta- 
tistical analysis. As a result, pair-wise deletion produces a larger effective sample size than list-wise 
deletion. 

Option one above is not a bad option unless a response for that particular respondent is cru- 
cial, which would rarely be the case. Option four could also be a good option if the response is 
important or if the effective sample size would be too small if all missing responses are deleted. As 
long as the researcher is confident that the imputation methods are providing good guesses, this 
method may allow a response to this item to be salvaged. 

The editor must decide whether an entire questionnaire is usable. When a questionnaire has 
too many missing answers, it may not be suitable for the planned data analysis. While no exact 
answer exists for this question, a questionnaire with a quarter of the responses or more missing 
is suspect. In such a situation the editor can record that a particular incomplete questionnaire has 
been dropped from the sample. 


Editing Questions Answered Out of Order 


Another task an editor may face is rearranging the answers given to open-ended questions such as 
may occur in a focus group interview. The respondent may have provided the answer to a subse- 
quent question in his or her comments to an earlier open-ended question. Because the respondent 
already had clearly identified the answer, the interviewer may not have asked the subsequent ques- 
tion, wishing to avoid hearing “I already answered that earlier” and to maintain interview rapport. 
If the editor is asked to list answers to all questions in a specific order, the editor may move certain 
answers to the section related to the skipped question. 


Facilitating the Coding Process 


While all of the previously described editing activities will help coders, several editing procedures 
are designed specifically to simplify the coding process. For example, the editor should check writ- 
ten responses for any stray marks. Respondents are often asked to circle responses. Sometimes, 
a respondent may accidentally draw a circle that overlaps two numbers. For example, the circle 
may include both 3 and 4. The editor may be able to decide which number is the most accurate 
response and indicate that on the form. Occasionally, a respondent may do this to indicate indeci- 
sion between the 3 and the 4. Again, if the editor sees that the circle is carefully drawn to include 
both responses, he or she may indicate a 3.5 on the form. Such ambiguity is impossible with an 
electronic questionnaire. 


EDITING AND TABULATING “DON’T KNOW” ANSWERS 


In many situations, respondents answer “don’t know.” On the surface, this response seems to indi- 
cate unfamiliarity with the subject matter at question. A legitimate “don’t know” response is the 
same as “no opinion.” However, there may be reasons for this response other than the legitimate 
“don’t know.” A reluctant “don’t know” is given when the respondent simply does not want to 
answer a question. For example, asking an individual who is not the head of the household about 
family income may elicit a “don’t know” answer meaning, “This is personal, and I really do not 
want to answer the question.” If the individual does not understand the question, he or she may 
give a confused “I don’t know” answer. 

In some situations the editor can separate the legitimate “don’t knows” (“no opinion”) 
from the other “don’t knows.” The editor may try to identify the meaning of the “don’t 
know” answer from other data provided on the questionnaire. For instance, the value of a 
home could be derived from knowledge of the zip code and the average value of homes within 
that area. 
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coding 


The process of assigning a 
numerical score or other charac- 
ter symbol to previously edited 
data. 


codes 


Rules for interpreting, classifying, 
and recording data in the coding 
process; also, the actual numeri- 
cal or other character symbols 
assianed to raw data. 
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In structured questionnaires, the researcher has to decide whether to provide the respondent 
with a “don’t know” or “no opinion” option. If neither of these is offered, the respondents may 
simply choose not to answer when they honestly don’t know how or don’t want to respond to 
a question. A computerized questionnaire can be set up to require a response to every question. 
Here, if a “no opinion” or “don’t know” opinion is not made available, the result is a forced 
choice design. The advantages and disadvantages of forced choice questioning were discussed in 
Chapter 14. 


Pitfalls of Editing 


Subjectivity can enter into the editing process. Data editors should be intelligent, experienced, 
and objective. A systematic procedure for assessing the questionnaires should be developed by the 
research analyst so that the editor has clearly defined decision rules to follow. Any inferences such 
as imputing missing values should be done in a manner that limits the chance for the data editor’s 
subjectivity to influence the response. 


Pretesting Edit 


Editing questionnaires during the pretest stage can prove very valuable. For example, if respon- 
dents’ answers to open-ended questions were longer than anticipated, the fieldworkers, respon- 
dents, and analysts would benefit from a change to larger spaces for the answers. Answers will 
be more legible because the writers have enough space, answers will be more complete, and 
answers will be verbatim rather than summarized. Examining answers to pretests may identify 
poor instructions or inappropriate question wording on the questionnaire. 


Coding 


Editing may be differentiated from coding, which is the assignment of numerical scores or clas- 
sifying symbols to previously edited data. Careful editing makes the coding job easier. Codes are 
meant to represent the meaning in the data. 

Assigning numerical symbols permits the transfer of data from questionnaires or interview 
forms to a computer. Codes often, but not always, are numerical symbols. However, they are more 
broadly defined as rules for interpreting, classifying, and recording data. In qualitative research, 
numbers are seldom used for codes. 


Coding Qualitative Responses 


UNSTRUCTURED QUALITATIVE RESPONSES (LONG INTERVIEWS) 


Qualitative coding was introduced in Chapter 7. In qualitative research, the codes are usually 
words or phrases that represent themes. Exhibit 19.2 shows a hermeneutic unit in which a qualita- 
tive researcher is applying a code to a text describing in detail a respondent’s reactions to several 
different glasses of wine. The researcher is trying to understand in detail what defines the wine 
drinking experience. In this case, coding is facilitated by the use of qualitative software. 

After reading through the text several times, and applying a word-counting routine, the 
researcher realizes that appearance, the nose (aroma), and guessing (trying to guess what the wine 
will be like or what type of wine is in the glass) are important themes. A code is assigned to these 
categories. Similarly, other codes are assigned as shown in the code manager window. The density 
column shows how often a code is applied. After considerable thought and questioning of the 
experience, the researcher builds a network, or grounded theory, that suggests how a wine may 
come to be associated with feelings of romance. This theory is shown in the network view. The 
reader interested in learning more about using software to help with qualitative coding should 
refer to the software sources provided in Chapter 7. 
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E STRUCTURED QUALITATIVE RESPONSES 


Qualitative responses to structured questions such as “yes” or “no” can be stored in a data file with 
letters such as “Y” or “N.” Alternatively, they can be represented with numbers, one each to repre- 
sent the respective category. So, the number 1 can be used to represent “yes” and 2 can be used to 
represent “no.” Since this represents a nominal numbering system, the actual numbers used are arbi- 
trary. Even though the codes are 
numeric, the variable is classifica- 
tory, simply separating the positive 
from the negative responses. 

For reasons that should 
become increasingly apparent in 
later chapters, the research may 
consider adopting dummy coding 
for dichotomous responses like 
yes or no. Dummy coding assigns 
a 0 to one category and a 1 to the 
other. So, for yes/no responses, a 
0 could be “no” and a 1 would 
be “yes.” Similarly, a “1” could 
represent a female respondent and 
a “0” would be a male respon- 
dent. Dummy coding provides 9rARFRIE— P3/4 
the researcher with more flexibil- 
ity in how structured, qualitative 
responses are analyzed statistically. 

Dummy coding can be used 
when more than two catego- 
ries exist, but because a dummy 
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EXHIBIT 19.2 
Coding Qualitative Data 
with Words 


dummy coding 


Numeric “1” or “0” coding where 
each number represents an alter- 
nate response such as “female” 
or “male.” 


Dummy coding is a simple 
(dummy-proof) way to 
represent classification 
variables. 
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field 


A collection of characters that 
represents a single type of 
data—usually a variable. 


string characters 


Computer terminology to repre- 
sent formatting a variable using 
a series of alphabetic characters 

(nonnumeric characters) that 
may form a word. 


record 


A collection of related fields that 
represents the responses from 
one sampling unit. 


data file 


The way a data set is stored 
electronically in spreadsheet-like 
form in which the rows represent 
sampling units and the columns 
represent variables. 
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variable can only represent two categories, multiple dummy variables are needed to represent a single 
qualitative response that can take on more than two categories. In fact, the rule is that if k is the num- 
ber of categories for a qualitative variable, k—1 dummy variables are needed to represent the variable. 


DATA FILE TERMINOLOGY 


Once structured, qualitative responses are coded, they are stored in an electronic data file. Here, 
both the qualitative responses and quantitative responses are likely stored for every respondent 
involved in a survey or interview. A terminology exists that helps describe this process and the 
file that results. 

Some of the terminology seems strange these days. For instance, what does a “card” have to 
do with a simple computer file? Most of the terminology describing files goes back to the early 
days of computers. In those days, data and the computer programs that produced results were 
stored on actual computer cards. Hopefully, readers will no longer have to use physical cards to 
store data. Much easier and more economical ways exist. 

Researchers organize coded data into cards, fields, records, and files. Cards are the collection 
of records that make up a file. A field is a collection of characters (a character is a single number, 
letter, or special symbol such as a question mark) that represents a single piece of data, usually a 
variable. Some variables may require a large field, particularly for text data; other variables may 
require a field of only one character. Text variables are represented by string characters, which 
is computer terminology for a series of alphabetic characters (non-numeric characters) that may 
form a word. String characters often contain long fields of eight or more characters. In contrast, 
a dummy variable is a numeric variable that needs only one character to form a field. 

A record is a collection of related fields. A record was the way a single, complete computer 
card was represented. Researchers may use the term record to refer to one respondent’s data. A data 
file is a collection of related records that make up a data set. 

Exhibit 19.3 shows the SPSS variable view used to describe the data in a file. Most of the head- 
ings are straightforward, beginning with the name of the variable, the type of variable (numeric 
or string), the size, the label, and so forth. Notice toward the bottom that the variable country is a 
string variable. The values for this variable are words that correspond to the country from which 
the specific record originates (United States, United Kingdom, Canada, or Australia). All of the 
remaining variables are numeric. 

The coder will sometimes like to associate a label with specific values of a numeric variable. 
Exhibit 19.3 shows the value labels dialog box that opens when the “Values” column is clicked. Notice 


EXHIBIT 19.3 Data Storage Terminology in SPSS 


Missing Columns Measure 


None 11 Right Scale 
None 10 Right Scale 
None 10 Right Scale 
Value Labels None 10 Right ‘Scale 
Value: 1 None 10 Right Scale 
Value Labet: [MBA] None 110 Right Scale 
-00 = "No degree" [None 10 Right Scale 
1.00 = "MBA" None 10 Right Scale A 
None 10 Right Scale R 
None 10 Right Scale fó] 
[None 10 Right Scale G 
Numeric U appy None None 10 Right Scale Ee 
Numeric 8 0 [Pleased None [None 10 Right Scale A 
Numeric 8 0 Turnover Ratin None None 10 Right Scale Ma 
‘Numeric 8 2 ILDO, No de =] None E Right Scale 2 
String (10 D None None 8 Left Nominal z 
3 


By clicking in the country row and values column, the value labels dialog box appears, which allows one to set each value to a text label as shown. 
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that the variable dummy contains an entry in this column. Value labels are extremely useful and allow a 
word or short phrase to be associated with a numeric coding. In this case, the value label helps describe 
whether or not someone has an MBA degree. The labels are matched to the numeric code as follows: 


value labels 
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Unique labels assigned to each 


possible numeric code for a 


response. 
= ae » 
e Ifdummy = 0, the value label is “no degree 
e Ifdummy = 1, the value label is “MBA” 
The analysts will no doubt appreciate the coder’s value labeling. Now, when frequencies or 
other statistical output is created for this variable, the value label will appear instead of simply 
a number. The advantage is that the analyst will not have to remember what coding was used. 
In other words, he or she won’t have to remember that a “1” meant an MBA. Other statistical 
programs accommodate value labels in similarly easy fashions. With SAS, the coder could create 
a format statement as follows: 
proc format; 
value labels 
0 = ‘none’ 
1 = ‘mba’; 
data chap19; 
input dummy perf sales; 
format dummy labels. ; 
This sequence reads three variables: dummy, perf (performance), and sales. Just as in the SPSS 
example, the sequence assigns the label “none” to a value of 0 for dummy and a label of “mba” 
to a value of 1 for dummy. 
x 
The Data File 
Data are generally stored in a matrix that resembles a common spreadsheet file. A data file stores 
the data from a research project and is typically represented in a rectangular arrangement (matrix) 
of data in rows and columns. Typically, each row represents a respondent’s scores on each variable 
and each row represents a variable for which there is a value for every respondent. Exhibit 19.4 
illustrates a data matrix corresponding to the variable view in Exhibit 19.3. In this case, data exist 
EXHIBIT 19.4 A Data File Stored in SPSS 
|= \profit.sav-~ SPSS Data Editor oo aaa 
||| 3| <|- || A Fle EEE] Sal 
1: performance 798651446517526 
performance | sales | margin | training | Experience | hours | labor | sdinvoie | sdexcite_| sdfun | sdsatisfied| sdhappy | sdpleased | turnover | dummy | country | = 
79.87 18058.89 569.45 -548.68 30.60 451.32 15751.25 Fi 9 7 5 6 6 4 00 USA 
84.36 14170.42 423.82 -434.78 18.01 565.22 12189.51 7 9. 7 4 5 4 5 1.00 USA 
85.55 16453.92 422.25 -495.32 20.81 503. 14636.66 7 8 7 F. 6 6 4 1,00 USA 
77.45 14645.76 395.14 -513.68 19.63 486.32 12791.48 cj 9 8 7 8 6 2 00 USA 
79.93 14668.96 529.97 -454.53 27.83 535.47 13108.65 8 9 X 5 5 5 4 00 USA 
85.13 17885.70 530.21 -688.61 9.86 311.39 15874.98 f 9 7 9 7 6 3 1,00 USA 
78.23 12383.36 342.54 -320.69 18.37 679.11 11212.39 7 8 7 1 2 2 7 DOUSA 
83.77 16995.14 517.69 -557.95 13.22 442.05 15022.62 6 8 7 1 2 1 4 1,00 USA 
76.43 15699.37 500.20 -571.49 24.74 428.51 14631.08 6 9 8 6 4 6 5 00 USA 
79.69 19195.29 658.54 -676.71 459 323.29 16992.71 6 8 7 5 3 6 6 00 USA 
78.04 14125.40 451.16 -438.34 23.05 561.66 12346.26 6 9 7 5 4 2 § 00 USA 
79.53 16808.55 556.25 -548.60 30.14 451.40 14797.34 7 9 7 6 5 3 rg 00 UK 
86.36 19780.06 594.57 -529.91 24.02 470.09 17408.46 6 9 7 6 4 3 4 1,00)U.K. 
77.39 15474.91 467.47 -421.39 29.23 578.61 13475.05 6 8 7 3 4 4 5 00 UK 
78.23 15246.43 427.79 -356.68 20.37 643.32 13687.20 6 g 7 7 6 7 5 00 U.K. 
81.74 15098.70 543,73 -491.15 29.84 508.85 13550.18 7 8 7 6 5 4 6 1,00 U.K. 
78.09 15291.91 504.61 -535.24 35.62 464.76 13450.87 6 8 7 7 5 5 2 00 U.K. 
83.74 15484.27 460.27 -415.54 9.56 584.46 13732.26 7 8 7 7 7 9 5 1.00 U.K. 
83.83 15969.66 443.03 -4987.34 35.01 512.66 13615.99 7 g 7 7 7 8 2 1.00 U.K 
82.03 17527.07 583.16 -565.25 14.69 334,75 15099.68 7 10 8 4 4 3 5 1.00 UK 
78.27 14135.63 418.59 -452.18 11.64 547.82 12323.91 7 9 8 6 6 4 7 1,00, U.K. 
87.36 19018.29 605.52 -596.95 29.48 403.05 16424.30 7 8 F 3 3 3 6 1.00 U.K 
62.87 16849.59 461.11 -398.13 31.35 601.87 14875.77 6 8 d 10 9 7 3 00 U.K. 
87.10 18727.75 528.75 -583.60 20.24 416.40 16336.70 7 8 7 EJ 8 7 1 1,00 UK 
79.00 15697.08 363.52 -445.11 35.55 554.89 13617.38 7 9 T 6 6 4 3 00 Australia 
80.35 13013.67 375.25 -328.54 9.34 671.46 11721.52 6 9 7 5 4 4 5 DO Australia 
80.73 15808.57 474.10 -480.89 14.43 519.11 13688.67 6 9 7 8 7 6 a 00 Australia 
78.84 19313.74 547.52 -703.95 22.94 296.05 17332.54 a 3 7 4 5 2 6 1,00 Australia 
81.28 17844.68 453.78 -524.12 17.86 375.88 15738.05 À 8 7 iá 5 6 4 00 Australia 
82.68 15478.02 477.68 -565.65 23.99 434,35 13534.37 6 Ss 7 6 7 5 4 00 Australia 
80.91 16367.82 388.47 -573.12 25.11 426,83 15207.33 6 8 7 6 5 3 4 00 Australia 
83.15 12882.19 382.08 -312.17 3.31 687.83 11397.11 7 8 7 3 2 1 6 1.00 Australia 
81.88 15652.54 404.64 -483.14 27.39 516.86 14974.15 6 8 7 4 4 4 4 1.00 Australia 
81.14 16322.91 542.30 -538.62 10.78 461.38 14161.58 7 8 7 4 4 2 6 1.00 Australia 
83.76 13717.67 336.68 -413.13 28.42 586.87 12481.54 T 8 8 a 4 2 7 1.00 Australia 
78.73 15810.64 465.86. -581.61 28.07 418.39 14091.86 6 8 7 6 5 6 5 00 Australia 
79.61 19956.91 499.44 -657.93 14.97 342.07 17633.32 6 8 7 5 5 4 8 00 Canada 
77.42 13040.16 399.78 -416.82 712 583.18 11384.96 6 8 7 F F 4 4 00 Canada 
82.71 15640.50 419.93 -383.09 10.00 616.91 13837.37 6 8 á 7 7 4 4 1.00 Canada 
82.23 19088.71 554.14 -590.94 33.80 409.06 16924.23 7 8 8 4 6 3 7 00 Canada 
4 |> \Data view £ Variable view / Le | ll 


SPSS Processor is ready 


COURTESY OF SPSS STATISTICS 17.0. 
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What is a petabyte? For those of you familiar with disk storage transactions are processed in real time, data 
measured in gigabytes (GB), a petabyte is 1,000,000 GBs. Who integrity and error checking are success fac- 
could possibly need such a large data system? Not surprisingly, tors valued by Wal-Mart executives. 

the largest retailer in the world—Wal-Mart. With over 800 million Over time, as the demands for richer, 


Building a Multi-Petabyte Data System 


to its success. Because virtually all of the 


transactions tied to over 30 million customers each day, the data more robust, and timely data analyses 


coding and analysis needs for such a system are clear. 


increase, Wal-Mart appears to have made the investments 


The design of the data system is a critical need for Wal-Mart. needed to grow their data warehouse into the future. In the 
Whether it is suppliers who wish to view product movement and future, there are even plans to have data marts—smaller, 
sales in real time, or execu- subject-specific data systems that can handle the needs of a 
tives who are interested in particular business area. 
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WE SELL FOR 


LESS 


business intelligence or Source: Hayes Weier, Mary, “Hewlett-Packard Data Warehouse Lands in Wal- 


scenario planning, the data Mart’s Shopping Cart,” Intelligent Enterprise (August 4, 2007), http://www. 
design aspect of Wal-Mart's intelligententerprise.com/showaArticle jhtml?articleID=201203079, accessed 
April 20, 2009. 


data warehouse is the key 


for 40 respondents. No doubt, the data file appears to be a spreadsheet. A spreadsheet like Excel 
is an acceptable way to store a data file, and increasingly, statistical programs like SPSS, SAS, and 
others can work easily with an Excel spreadsheet. The careful construction of data files are criti- 
cal to business research. For some businesses, their data is coded and stored in data warehouses. 
These data warehouses, where customer, supplier, and organization level data are coded, stored, 
and analyzed, are often the lifeblood of the company. The Research Snapshot above highlights the 
size and investment companies have in such data storage systems. 

Each column in Exhibit 19.4 represents a particular variable. The first two columns are ratio 
variables representing hours worked and labor costs, respectively. The next seven columns are vari- 
ables taken from survey questions. Six of these are semantic differential scales that are scored from 
1 to 10 based on the respondent’s opinion. The next variable is a variable indicating likelihood of 
quitting, also using a 10-point scale. Finally, the last two variables, dummy and country, represent 
whether or not the respondent has an MBA and in which country he or she works, respectively. 


Code Construction 


There are two basic rules for code construction. First, the coding categories should be exhaustive, mean- 
ing that a coding category should exist for all possible responses. With a categorical variable such as sex, 
making categories exhaustive is not a problem. However, trouble may arise when the response repre- 
sents a small number of subjects or when responses might be categorized into a class not typically found. 
For example, when questioned about automobile ownership, an antique car collector might mention 
that he drives a Packard Clipper. This may present a problem if separate categories have been developed 
for all possible makes of cars. Solving this problem frequently requires inclusion of an “other” code 
category to ensure that the categories are all-inclusive. For example, household size might be coded 1, 
2, 3, 4, and 5 or more. The “5 or more” category assures all subjects of a place in a category. 

Missing data should also be represented with a code. In the “good old days” of computer 
cards, a numeric value such as 9 or 99 was used to represent missing data. Today, most software 
will understand that either a period or a blank response represents missing data. 

Second, the coding categories should be mutually exclusive and independent. This means that 
there should be no overlap among the categories to ensure that a subject or response can be placed 
in only one category. 


Precoding Fixed-Alternative Questions 


When a questionnaire is highly structured, the categories may be precoded before the data are collected. 
Exhibit 19.5 presents a questionnaire for which the precoded response categories were determined 
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Precoding Fixed-Alternative Responses 


29. Do you—or does anyone else in your immediate household—belong to a labor union? 


'L] Yes, | personally belong to a labor union. 
2L] Yes, another member of my household belongs to a labor union. 
3L] No, no one in my household belongs to a labor union. 


30. Are you the male or female head of the household—that is, the person whose income is the chief source of support of 


the household? 
1L] Yes 2L] No 


31. Would you please check the appropriate combined yearly income (before income taxes and any other payroll 
deductions) from all sources of all those in your immediate household? (Please include income from salaries, 
investments, dividends, rents, royalties, bonuses, commissions, etc.) Please remember that your individual answers 
will not be divulged. 


1C] Less than $4,000 7L] $8,000-$8,999 133C] $25,000-$29,999 

2C] $4,000-$4,999 sC] $9,000-$9,999 140C] $30,000-$39,999 

3L] $5,000-$5,999 °C] $10,000-$12,499 '5_] $40,000-$49,999 

“Ll $6,000-$6,999 1] $12,500-$14,999 16C] $50,000-$74,999 

SL] $7,000-$7,499 uC] $15,000-$19,999 vC] $75,000-$99,999 

sC] $7,500-$7,999 2] $20,000-$24,999 18_] $100,000 or more 
32. a. Do you personally own corporate stocks? 'L] Yes 2L] No 


b. Do you own stocks in the corporation for which you work? 
Do you own them in a corporation for which you do not work? 
(Please check as many as apply.) 


Own STOCK in: 


1L] Company for which | work 2L] Other company 
THANK YOU VERY MUCH FOR YOUR COOPERATION 
If you would like to make any comments on any of the subjects covered in this study, please use the space below: 


before the start of data collection. The codes in the data file will correspond to the small numbers beside 
each choice option. In most instances, the codes will not actually appear on the questionnaire. 

The questionnaire in Exhibit 19.5 shows several demographic questions classifying individu- 
als’ scores. Question 29 has three possible answers, and they are precoded 1, 2, 3. Question 30 asks 
a person to respond “yes” (1) or “no” (2) to the question “Are you the male or female head of the 
household?” Once again, technology is making things easier and much of this type of coding is 
automated. For users of Web-based survey services, all that one need do is submit a questionnaire 
and in return he or she will receive a coded data file in the software of his or her choice. 

Telephone interviews are still widely used. The partial questionnaire in Exhibit 19.6 on the 
next page shows a precoded format for a telephone interview. In this situation the interviewer 
circles the coded numerical score as the answer to the question. 

Precoding can be used if the researcher knows what answer categories exist before data collec- 
tion occurs. Once the questionnaire has been designed and the structured (or closed-form) answers 
identified, coding then becomes routine. In some cases, predetermined responses are based on stan- 
dardized classification schemes. A coding framework that standardizes occupation follows: 


What is your occupation? (PROBE: What kind of work is that?) 


01 Professional, technical, and kindred workers 09 Laborers, except farm and mine 
02 Farmers 10 Retired, widow, widower 

03 Managers, officials, and proprietors 11 Student 

04 Clerical 12 Unemployed, on relief, laid off 
05 Sales workers 13 Homemaker 

06 Craftsmen, foremen, and kindred workers 14 Other (specify) 

07 Operatives and kindred workers 99 No occupation given 


08 Service workers 
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r 19.6 Precoded Format for Telephone Interview 


Study #45641 

Travel (Telephone Screening) 
City: 

Chicago 

Gary 

Ft. Wayne 

Bloomington 

Hello, I’m 


For office use only 
Respondent # 


from , a national survey research company. We are conducting a study and would like to ask you a 


few questions. 


A. Before we begin, do you—or any member of your family—work for... 
1 Atravelagency 2 Anadvertisingagency 3 Amarketing research company 
(If“yes” to any of the above, terminate and tally on contact sheet) 
B. By the way, have you been interviewed as part of a survey research study within the past month? 
1 Yes—(Terminate and tally on contact sheet) 


2 No—(Continue) 


1. Have you yourself made any trips of over 100 miles within the continental 48 states in the past 3 months? 


1 Yes 


2 No—(Skip to Question 10) 
2. Was the trip for business reasons (paid for by your firm), vacation, or personal reasons? 


Last Trip Second Last Trip Other Trips 
Business il 1 1 
Vacation 2 2 2 
Personal (excluding a vacation) 5) 3 3 


Computer-assisted telephone interviewing (CATI) requires precoding. Changing the cod- 
ing framework after the interviewing process has begun is extremely difficult because it requires 
changes in the computer programs. In any event, coding closed-ended structured responses is a 
straightforward process of entering the code into the data file. 


More on Coding Open-Ended Questions 


Surveys that are largely structured will sometimes contain some semi-structured open-ended ques- 
tions. These questions may be exploratory or they may be potential follow-ups to structured ques- 
tions. The purpose of coding such questions is to reduce the large number of individual responses 
to a few general categories of answers that can be assigned numerical codes. 

Similar answers should be placed in a general category and assigned the same code much as 
the codes are assigned in the qualitative sample involving wine consumption above, except in this 
case, a small amount of data may be obtained from a large number of respondents, whereas in the 
hermeneutic unit above, a large amount of data is obtained from one or a small number of respon- 
dents. For example, a consumer survey about frozen food also asked why a new microwaveable 
product would not be purchased: 


e We don’t buy frozen food very often. 

e like to prepare fresh food. 

e Frozen foods are not as tasty as fresh foods. 
e I don’t like that freezer taste. 


All of these answers could be categorized under “dislike frozen foods” and assigned the code 1. 
Code construction in these situations reflects the judgment of the researcher. 

A major objective in the code-building process is to accurately transfer the meanings from 
written responses to numeric codes. Experienced researchers recognize that the key idea in this 
process is that code building is based on thoughts, not just words. The end result of code build- 
ing should be a list, in an abbreviated and orderly form, of all comments and thoughts given in 
answers to the questions. 
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Developing an appropriate code from the respondent’s exact comments is somewhat of an art. 
Researchers generally perform a test tabulation to identify verbatim responses from approximately 
20 percent of the completed questionnaires and then establish coding categories reflecting the 
judgment of the person constructing the codes. Test tabulation is the tallying of a small sample of 
the total number of replies to a particular question. The purpose is to preliminarily identify the  Tallying of a small sample of 
stability and distribution of answers that will determine a coding scheme. Exhibit 19.7 illustrates the total number of replies to a 

De ws ts ee particular question in order to 
open-ended responses and preliminary open-ended codes generated for the question “Why does — Construct codin J categanies 
the chili you just tasted taste closer to homemade?” During the coding procedure, the respon- 
dent’s opinions are divided into mutually exclusive thought patterns. These separate divisions may 


test tabulation 


consist of a single word, a phrase, or a number of phrases, but in each case represent only one 
thought. Each separate thought is coded once. When a thought is composed of more than one 
word or phrase, only the most specific word or phrase is coded. 


EXHIBIT 19.7 Coding Open-Ended Questions about Chili 


You don’t get that much meat in a can. A , 
The beans are cooked just right. 1. Don't get that much meat in a can 
It just (doesn’t look) like any canned chili I’ve had. | can see spices: 2. Beans are cooked just right 

I've never seen it in any canned chili. 


It is not too spicy, 3. lcan see spices 

but it is tasty—savory. 4: Not too spicy 

It’s not (loaded with beans)—just enough beans. 5. Itis ey 

It’s moist—not too chewy. 6. Has just enough beans 
7. Moist 
8. Not too chewy 

( ). 
Tasses iess 9. Fresh taste 


The canned stuff is too (soft). Too overcooked usually. 
It doesn't have a lot of filler and not too many beans. 


10. Canned is usually overcooked 
11. Nota lot of filler 
12. Not too many beans 


It's not too spicy. It’s not too hot, it's mild. 13. Not too hot, it’s mild 
Has enough spice to make it tastier. 14. Has enough spice 
It seems to have a pretty good gravy. Some are watery. 15. Gravy not watery 


Walker Research, “Coding Open Ends Based on Thoughts,’ The Marketing Researcher, December 1979, pp. 1-3. 


After tabulating the basic responses, the researcher must determine how many answer catego- The coder will try to classify 
all of the comments from the 


ries will be acceptable. This will be influenced by the purpose of the study and the limitations of Alesina endear 
the computer program or plan for data entry. For example, if only one single-digit field is assigned facilitates analysis. 

to a particular survey question, 
the number of possible categories 
is limited. If an “other” or “mis- 
cellaneous” code category appears 
along with a “don’t know/no 
answer” category, the code con- 
struction will be further limited. 


Devising the 
Coding Scheme 


A coding scheme should not be 
too elaborate. The coder’s task 
is only to summarize the data. 
Exhibit 19.8 on the next page 
shows a test tabulation of airport 
visitors’ responses to a question 
that asked for comments about 
the Honolulu Airport. After the 
first pass at devising the coding 
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Open-Ended Responses to a 
Survey about the Honolulu 
Airport 


Part 6: Data Analysis and Presentation 


Prices high: restaurant/coffee shop/snack bar 90 
Dirty—filthy—smelly restrooms/airport 65 
Very good/good/excellent/great 59 
Need air-conditioning 52 
Nice/beautiful 45 
Gift shops expensive 32 
Too warm/too hot 31 
Friendly staff/people 25 
Airport is awful/bad 23 
Long walk between terminal/gates 21 
Clean airport i7 
Employees rude/unfriendly/poor attitude 16 
More signs/maps in lobby/streets 16 
Like it 15 
Love gardens 11 
Need video games/arcade 10 
More change machines/different locations 8 


More padded benches/comfortable waiting area 
More security personnel including HPD 

Replace shuttle with moving walkways 
Complaint: flight delay 

Cool place 

Crowded 

Provide free carts for carry-on bags 

Baggage storage inconvenient/need in different locations 
Floor plan confusing 

Mailbox locations not clear/more needed 

More restaurants and coffee shops/more variety 
Need a place to nap 

Polite VIP/friendly/helpful 

Poor help in gift shops/rude/unfriendly 

Slow baggage delivery/service 

Very efficient/organized 

Excellent food 

Install chilled water drinking fountains 

Love Hawaii 

More TV sets 

Noisy 

People at sundries/camera rude 

Shuttle drivers rude 

Something to do for passengers with long waits 
Airport too spread out 

Better information for departing/arriving flights 
Better parking for employees 

Better shuttle service needed 

Cute VIP 
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scheme, the researcher must decide whether to revise it and whether the codes are appropriate for 
answering management’s questions. A preliminary scheme with too many categories can always be 
collapsed or reduced later in the analysis. If initial coding is too abstract and only a few categories 
are established, revising the codes to more concrete statements will be difficult unless the raw data 
were recorded. 

In the Honolulu Airport example, the preliminary tabulation contained too many codes, 
but it could be reduced to a smaller number of categories. For example, the heading “Friendly/ 
attractive personnel” could include the responses “Friendly staff/people,” “Polite VIP/friendly/ 
helpful,” and “Cute VIP.” Experienced coders group answers under generalized headings that 
are pertinent to the research question. Individual coders should give the same code to similar 
responses. The categories should be sufficiently unambiguous that coders will not classify items in 
different ways. 

Coding open-ended questions is a very complex issue. Certainly, this task cannot be mastered 
simply from reading this chapter. However, the reader should have a feel for the art of coding 
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l Coding Data “On-the-Go” and proprietary voice recognition software to execute voice com- 


= * Collecting business-critical data takes mands to store, code, or recode data hands-free. For the forklift 
time. Often data collection specialists driver, data can be entered through voice commands, thus allow- 
and researchers must stop their other organiza- ing them to continue to work within their warehouse without any, 
tional responsibilities to code a data value into a productivity downtime. In many } 


spreadsheet or business database. This can take valuable and ways, taking advantage of the 
productive time away from their other responsibilities. For exam- portability of cellular technology 
ple, a warehouse worker operating a forklift might need to code is a natural fit for supply chain 
where a particular pallet of product is in a warehouse, after they companies. Using Vangard Voice’s 
have moved it from one section to another. This would require AccuSpeech, data can truly be col- 
that they stop and code into a computer the new pallet location. lected and coded “on-the-go”! 
Vangard Voice Systems aims to change this in a big way. eB nce: INAANO EC 

Vangard’s AccuSpeech and Mobile Voice Platform (MVP) is a Vangard Voice Systems, accessed April 19, 
mobile enterprising system that uses cellular phone technology 2009. 


responses into similar categories. With practice, and by using multiple coders so that consistency 
can be examined, one can become skilled at this task. 


Code Book 


A code book gives each variable in the study and its location in the data matrix. In essence, the 
code book provides a quick summary that is particularly useful when a data file becomes very large. 
Exhibit 19.9 on the next page illustrates a portion of a code book from the telephone interview 
illustrated in Exhibit 19.6. Notice that the first few fields record the study number, city, and other 
information used for identification purposes. Researchers commonly identify individual respon- 
dents by giving each an identification number or questionnaire number. When each interview is 
identified with a number entered into each computer record, errors discovered in the tabulation 
process can be checked on the questionnaire to verify the answer. 


Editing and Coding Combined 


Frequently the person coding the questionnaire performs certain editing functions, such as 
translating an occupational title provided by the respondent into a code for socioeconomic 
status. A question that asks for a description of the job or business often is used to ensure that 
there will be no problem in classifying the responses. For example, respondents who indi- 
cate “salesperson” as their occupation might write their job description as “selling shoes in a 
shoe store” or “selling IBM supercomputers to the defense department.” Generally, coders are 
instructed to perform this type of editing function, seeking the help of a tabulation supervisor 
if questions arise. 


Computerized Survey Data Processing 


In most studies with large sample sizes, a computer is used for data processing. The process of 
transferring data from a research project, such as answers to a survey questionnaire, to computers 
is referred to as data entry. Several alternative means exist for entering data into a computer. In 
studies involving highly structured paper and pencil questionnaires, an optical scanning system 
may be used to read material directly into the computer’s memory from mark-sensed question- 
naires. The form may look similar to the type a student uses to take a multiple-choice test. As 
seen in the Research Snapshot above, even mobile phone technology is now being used to aid 
data processing. 


code book 


A book that identifies each va 


ri- 


able in a study and gives the vari- 
able’s description, code name, 


and position in the data matri 


data entry 


x. 


The activity of transferring 


data from a research project to 


computers. 


optical scanning system 


A data processing input devic 


E 


that reads material directly from 


mark-sensed questionnaires. 
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EXHIBIT 19.9 
Portion of a Code Book from 
a Travel Study 


Part 6: Data Analysis and Presentation 


Study #45641 
January 20__ 
N = 743 


Question Field or Column 
Number Number Description and Meaning of Code Values 


— 1-5 Study number (45641) 


= 6 City 
1. Chicago 
2. Gary 
3. Ft. Wayne 
4. Bloomington 


— 7-9 Interview number (3 digits on upper left-hand 
corner of questionnaire) 


A Not entered Family, work for 
1. Travel agency 
2. Advertising agency 
3. Marketing research company 


B Not entered Interviewed past month 
1. Yes 
2. No 


il 10 Traveled in past 3 months 
1. Yes 
2. No 


2 11 Purpose last trip 
1. Business 
2. Vacation 
3. Personal 


12 Purpose second last trip 
1. Business 
2. Vacation 
3. Personal 


13 Purpose other trips 
1. Business 
2. Vacation 
3. Personal 


In a research study using computer-assisted telephone interviewing or a self-administered 
Internet questionnaire, responses are automatically stored and tabulated as they are collected. 
Direct data capture substantially reduces clerical errors that occur during the editing and coding 
process. If researchers have security concerns, the data collected in an Internet survey should be 
encrypted and protected behind a firewall. 

As the opening vignette shows, collecting data using computer technology is an ever- 
growing phenomenon in business research. When data are not optically scanned or directly 
entered into the computer the moment they are collected, data processing begins with key- 
boarding. A data entry process transfers coded data from the questionnaires or coding sheets 
onto a hard drive. As in every stage of the research process, there is some concern about 
whether the data entry job has been done correctly. Data entry workers, like anyone else, 
may make errors. To ensure 100 percent accuracy in transferring the codes, the job should be 
verified by a second data entry worker. If an error has been made, the verifier corrects the data 
entry. This process of verifying the data is never performed by the same person who entered 
the original data. A person who misread the coded questionnaire during the keyboarding 
operation might make the same mistake during the verifying process, and the mistake might 
go undetected. 


Error Checking 


The final stage in the coding process is error checking and verification, or data cleaning, to ensure 
that all codes are legitimate. For example, computer software can examine the entered data and 


A 
m 


data is not missing randomly. Several options for dealing with 
missing data exist. 


e Check responses for inconsistent e Replace missing responses with some actual value 
answers. imputed to minimize chance error. 

n e Remove any specific piece of data that is - Imputation should be done with great care as it is at 

= indicated by inconsistent responses. best a sophisticated guess. 

o 

Z e Include check questions—particularly on e Pair-wise deletion is a good way to handle missing data in 

5 lengthy questionnaires or any time when most applications. 

ð 

4 respondents may have very low involvement. e Take advantage of technology. When possible, use a comput- 

Be Missing data can be a problem, particularly when the missing erized survey tool. 

o 

S 

o 

© 


identify coded values that lie outside the range of acceptable answers. For example, if “sex” is 
coded 1 for “male” and 2 for “female” and a 3 code is found, a mistake obviously has occurred 
and an adjustment must be made. 


Summary 


1. Know when a response is really an error and should be edited. Data editing is necessary before 
coding and storing the data file. The data editor must sometimes alter a respondent’s answer. 
Often, this situation arises because of inconsistent responses; that is, responses to different ques- 
tions that contradict each other. The editor should be cautious in altering a respondent’s answer. 
Only when a certain response is obviously wrong and the true response is easily determined 
should the coder substitute a new value for the original response. Ideally, multiple pieces of evi- 
dence would suggest the original response as inaccurate and also suggest the accurate response 
before the respondent takes such a step. Missing data should generally be left as missing, although 
imputation methods exist to provide an educated guess for missing values. These imputation 
methods can be used when the sample size is small and the researcher needs to retain as many 
responses as possible. 


2. Appreciate coding of pure qualitative research. Qualitative research such as typified by depth 
interviews, conversations, or other responses is coded by identifying the themes underlying some 
interview. The codes become a key component of a hermeneutic unit that ultimately can be 
linked to one another to form a grounded theory. The frequency with which some thought is 
expressed helps to identify appropriate coding for unstructured qualitative data. 


3. Understand the way data are represented in a data file. A survey provides an overview of 
respondents based on their answers to questions. These answers are edited, coded, and then 
stored in a data file. The data file is structured as a data matrix in which the rows represent 
respondents and the columns represent variables. Thus, a survey in which 200 respondents 
are asked 50 structured questions would result in a data matrix consisting of 200 rows and 
50 columns. 


4. Understand the coding of structured responses including a dummy variable approach. 
Quantitative structured responses are generally coded simply by marking the number correspond- 
ing to the choice selected by the respondent. Qualitative structured responses must also be coded. 
Dichotomous variables lend themselves well to dummy coding. With dummy coding, the two 
possible choices to a question are coded with a “1” for one response and a “0” for the other. 
Short-answer or list questions are coded by assigning a number to all responses that seem to sug- 
gest the same theme even if different words are used. 


5. Appreciate the ways that technological advances have simplified the coding process. 
Throughout the chapter, technological advances in data collection were mentioned. These 
advances have automated a great deal of data coding and reduced the chances of respon- 
dent error. For instance, some inconsistent responses can be automatically screened and the 
respondent can be prompted to go back and correct a response that seems inconsistent. Also, 
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if a respondent fails to answer a question, a pop-up window can take that respondent back 
to the question and force him or her to respond in order to continue through the rest of the 


questionnaire. 


Key Terms and Concepts 


code book, 477 editing, 463 
codes, 468 field, 470 
coding, 468 field editing, 464 
data entry, 477 impute, 466 


data file, 470 
data integrity, 463 
dummy coding, 469 


in-house editing, 464 
item nonresponse, 466 


nonrespondent error, 462 


optical scanning system, 477 
plug value, 466 

raw data, 462 

record, 470 

string characters, 470 

test tabulation, 475 

value labels, 471 


Questions for Review and Critical Thinking 


1: 


What is the purpose of editing? Provide some examples of 
questions that might need editing. 

When should the raw data from a respondent be altered by a 
data editor? 

How is data coding different from data editing? 

A 25-year-old respondent indicates that she owns her own 
house in Springfield, Illinois, and it is valued at $990 million. 
Later in the interview, she indicates that she didn’t finish high 
school and that she drives a 1993 Buick Century. Should the 
editor consider altering any of these responses? If so, how? 
What role might a word counter play in coding qualitative 
research results? 

A survey respondent from Florida has been asked to respond as 
to whether or not he or she owns a boat, and if so, whether he 
or she stores the boat at a marina. Over two hundred respon- 
dents are included in this sample. What suggestions do you 
have for coding the information provided? 

How would a dummy variable be used to represent whether or 
not a respondent in a restaurant ordered dessert after their meal? 
List at least three ways in which recent technological advances 
(within the last 15 years) have changed the way data are coded. 
ETHICS A large retail company implements an employee survey 
that ostensibly is aimed at customer satisfaction. The survey 


Research Activities 


Design a short questionnaire with fewer than five fixed- 
alternative questions to measure student satisfaction with your 
college bookstore. Interview five classmates and then arrange 
the database into a data matrix. 


10. 


11. 


123 


includes a yes or no question that asks whether or not the 
employee has ever stolen something from the workplace. How 
could this data be coded? What steps could be attempted to 

try and ensure that the employee’s response is honest? Do you 
believe it is fair to ask this question? Should the employee take 
action against employees who have indicated that they have stolen 
something? 

A researcher asks, “What do you remember about advertis- 
ing for Gillette Turbo razors?” A box with enough room for 
100 words is provided in which the respondent can answer the 
question. The survey involves responses from 250 consumers. 
How should the code book for this question be structured? 
What problems might it present? 

‘NET Use http://www.naicscode.com to help with this response. 
What is the NAICS code for golf (country) clubs? What is the 
NAICS code for health clubs? How can these codes be useful 
in creating data files? 

‘NET Explore the advantages of computerized software such as 
ATLAS.ti. The Web site is at http://www.atlasti.com. How do 
you think it might assist in coding something like a depth inter- 
view or a collage created by a respondent? 


‘NET The Web page of the Research Triangle Institute (http:// 
www.rti.org) describes its research tools and methods in some detail. 
Click on tools and methods and explore the surveys and survey tools 
described there. How might these methods assist in coding? 
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Case 19.1 U.S. Department of the Interior Heritage Conservation and Recreation Service 
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Some years ago the U.S. Department of the 
Interior conducted a telephone survey to help 
plan for future outdoor recreation. A nine- 
| page questionnaire concerning participation in 
outdoor recreational activities and satisfaction 
with local facilities was administered by the 


Opinion Research Corporation of Princeton, 
New Jersey, to 4,029 respondents. The last two pages of the 
questionnaire appear in Case Exhibit 19.1-1. Assume the data 


Sample Page from Questionnaire 


The following questions are for background purposes. 
32. Doyouliveinan... 

Urban location 

Suburban location 

Rural location 


33. Counting yourself, how many members of your family live here? 
(If “1” on Q.33, go to Q.35) 


34. How many family members are... 
Over 65 years 
40 to 65 years 
21 to 39 years 
12 to 20 years 
5 to 11 years 
Under 5 years 


35. What is your age? (Years) 


36. In school, what is the highest grade (or year) you have com- 
pleted? (Circle response) 
Elementary school 01 02 03 04 05 06 
Junior high school 07 08 


High school 09 10 11 12 
College 13 14 15 16 
Graduate school 17 18 19 20 21 


37. What is your occupation? What kind of work is that? 
Professional, technical, and kindred workers 
Farmers 


Managers, officials, and proprietors 
Clerical and kindred workers 
Sales workers 


will be entered into a data file in which each data entry should 
include the following information: 


e Respondent number 
¢ — State code (all 50 states) 


Question 

Design the coding for this portion of the questionnaire. Assume that 
the data from previous pages of the questionnaire will follow these 
data. 


Craftspersons, forepersons, and kindred workers 
Operatives and kindred workers 

Service workers 

Laborers, except farm and mine 


Retired, widow, widower 
Student 

Unemployed, on relief, laid off | Go to Q.43 
Housewife 


Other (specify) 


38. How many hours a week do you work at your place of 
employment? __ (hours) 


39. How many days of vacation do you get in a year? __ (days) 


40. Please tell me which of the following income categories most 
closely describe the total family income for the year before 
taxes, including wages and all other income. Is it... 


Under $12,000 
$12,000-$20,000 
$20,001-$30,000 
$30,001-$50,000 
$50,001-$100,000 
Over $100,001 


41. Sex of respondent... 
Male 
Female 


42. What is the zip code at your place of employment? 
This concludes the interview; thank you very much for your coopera- 
tion and time. 


Case 19.2 Shampoo 9-10 
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A shampoo, code named “9—10” was given 
to women for trial use.t The respondents 
were asked what they liked and disliked about 
the product. Some sample codes are given in 
Case Exhibits 19.2-1 and 19.2—2. 

There were two separate sets of codes: the 


codes in Case Exhibit 19.2—1 were for coding 
the respondents’ likes, and the codes in Case Exhibit 19.2—2 were 


for coding their dislikes. The headings identify fields in the data 
matrix and the different attributes of shampoo. The specific codes 
are listed under each attribute. The coding instructions were first to 
look for the correct heading, and then to locate the correct com- 
ment under that heading and use that number as the code. 

For example, if, in response to a “like” question, a respon- 
dent had said, “The shampoo was gentle and mild,” a coder would 
look in field 10, the “gentleness” field, and find the comment 
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“Gentle/mild/not harsh”; then the coder would write “11” next The sample questionnaires appear in Case Exhibit 19.2-3. 
to the comment. If, under “dislikes,” someone had said, “I would 

rather have a shampoo with a créme rinse,” the coder would look Questions 

in field 16 for comparison to other shampoos and write “74” 1. Code each of the three questionnaires. 


(“Prefer one with a crême rinse”) beside that response. 


Sample Codes for “Like” Questions 


Field 10 Gentleness 
11 Gentle/mild/not harsh 


2. Evaluate this coding scheme. 


Test No. Shampoo 
Question: Likes 


Field 11 Result on Hair 
21 Good for hair/helps hair 


12 Wouldn't strip hair of natural oils 


13 Doesn't cause/helps flyaway hair 


22 Leaves hair manageable/no tangles/no need for crême rinse 


23 Gives hair body 


14 Wouldn't dry out hair 


24 Mends split ends 


15 Wouldn't make skin/scalp break out 


16 Organic/natural 


25 Leaves hair not flyaway 


26 Leaves hair silky/smooth 


17 27 Leaves hair soft 

18 28 Leaves hair shiny 

19 29 Hair looks/feels/good/clean 
20 30 

I 2= 


1+ Other gentleness 


2+ Other results on hair 


Field 12 Cleaning 


31 Leaves no oil/keeps hair dry 


Field 13 Miscellaneous 


41 Cheaper/economical/good price 


32 It cleans well 


42 Smells good/nice/clean 


33 Lifts out oil/dirt/artificial conditioners 


43 Hairdresser recommended 


34 Don't have to scrub as much 


44 Comes in different formulas 


35 No need to wash as often/keeps hair cleaner longer 


45 Concentrated/use only a small amount 


36 Doesn't leave a residue on scalp 


46 Good for whole family (unspecified) 


37 Good lather 47 
38 Good for oily hair 48 
39 49 
40 50 
3z 4— Other miscellaneous 


3+ Other cleaning 


4+ Don'tknow/nothing 
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Sample Codes for “Dislike” Questions 


Field 14 Harshness 


Test No. Shampoo 
Question: Dislikes 


Field 15 Cleaning 


51 Too strong 61 Doesn't clean well 

52 Strips hair/takes too much oil out 62 Leaves a residue on scalp 
53 Dries hair out 63 Poor lather 

54 Skin reacts badly to it 64 Not good for oily hair 
55 65 

56 66 

S 67 

58 68 

59 69 

60 70 

5> 65 

5+ Other harshness 6+ Other cleaning 


Field 16 Comparison to Others 


Field 17 Miscellaneous 


71 Prefer herbal/organic shampoo 81 Don't like the name 

72 Prefer medicated/dandruff shampoo 82 Too expensive 

73 Same as other shampoos—doesn’t work any differently 83 Not economical for long hair 

74 Prefer one with a crême rinse 84 Use what hairdresser recommends 
75 Prefer another brand (unspecified) 85 

76 86 

77 87 

78 88 

79 89 

80 90 

= 8— Other miscellaneous 

7+ Other comparison to others 8+ Don’t know what/disliked/nothing 
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Sample Questionnaires for Shampoo 9-10 Survey 


1. What, if anything, did you particularly like about 
this shampoo? 


My had dresser re Commend S +, So 


o mast he good for youn hace . I+ 
Smells ocol Xoo. 


2. What, if anything, did you particularly dislike about 
this shampoo? 


145 foo ex pousive.. HH doesnt hare a 
Cream rinse se yau stil! pave to Duar 
Yhat bo. (H rear ly doesnt Oor i be her 
Yhan other Shawn pwo 5 Lor She amount Z 


money Up Pass lr Cb, 
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CHAPTER 20 
BASIC DATA 
ANALYSIS: 
DESCRIPTIVE 
After studying this chapter, you should be able to ST ATI STI C S 


1. Know what descriptive statistics are and why they are 
used 


2. Create and interpret simple tabulation tables 
3. Understand how cross-tabulations can reveal relationships 
4. Perform basic data transformations 


5. List different computer software products designed for 
descriptive statistical analysis 


6. Understand a researcher's role in interpreting the data 


Chapter Vignette: Choose Your “Poison” 


Most Americans enjoy an adult beverage occasionally. But not all Americans like the same 
drink. Many decision makers are interested in what Americans like to drink. Retailers need 
to have the correct product mix for their particular customers if profits are to be increased 
and customers made more satisfied. Restaurants need to know what their customers like to 
have with the types of food they serve. Policy makers need to know what types of restrictions 
should be placed on what types of products to prevent underage drinking and alcohol abuse. 
Researchers could apply sophisticated statistics to address questions related to Americans’ 
drinking preferences, but a lot can be learned from just counting 
what people are buying. 

A grocery store built in 1975 in Chicago allocates 15 per- 
cent of their floor space to adult beverage products. Out of 
this 15 percent, 60 percent is allocated to beer, 25 percent 
to spirits, and 15 percent to wine. Since the products are 
not merchandised the same way (different types of shelving, 
aisles, and racking are needed), adjusting the floor space to 
change these percentages is not an easy task. Over the three- 
decade history of the store, the customer base has changed. 
Originally, stay-at-home moms buying groceries for the fam- 
ily best characterized the customer base. During the 1990s, 
empty-nesters, including retirees with high disposable incomes, 
characterized the customer base. More recently, younger 
singles just starting careers have moved into the nearby neigh- 
borhoods. Should the store reconsider its adult beverage mer- 
chandising? 

In 1992, American consumers showed a heavy prefer- 
ence toward beer. Among American adults who drank adult 
beverages,’ 


+ 47 percent drank beer 
+ 21 percent drank spirits 
+ 27 percent drank wine 


By 2005, Americans had changed their drinking preferences. Now, 


+ 36 percent drink beer 
+ 21 percent drink spirits 
+ 39 percent drink wine 
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A couple of other facts have become clear. A count of the preferred beverages among American adult 
consumers 29 and younger shows the following preferences in 2005: 


+ 48 percent drink beer 
+ 32 percent drink liquor 
* 17 percent drink wine 


Perhaps due to the emergence of this younger group, a 2008 study shows beer has regained the posi- 
tion as America’s favorite adult beverage: 


+ 42 percent drink beer 
+ 23 percent drink spirits 
+ 31 percent drink wine 


Across America, grocers account for 35 percent of all beer sales, but convenience stores, where 
younger consumers tend to shop, account for 45 percent.? If the grocery store is converting more to a 
convenience store, maybe a continued emphasis on beer is wise. However, wine consumers are more 
attractive from several perspectives. Wine now ranks among the top 10 food categories in America, 
based on grocery store dollar sales volume. Forty-five percent of all wine is sold in grocery stores. 
What we find is that the consumer who buys wine is also more likely to buy products like prime or 
choice beef and imported cheeses, instead of lower quality and lower priced meat and cheese prod- 
ucts. As a result, the average $13.44 spent on wine in a grocery store (as opposed to $11.94 on beer) is 
only part of the story in explaining why wine customers may be grape customers!* 

What should the grocer emphasize in marketing adult beverages? Perhaps the research based on 
counting can address this decision. 


descriptive analysis 


The elementary transformation of 
raw data in a way that describes 
the basic characteristics such as 

central tendency, distribution, 
and variability. 


Introduction 


Perhaps the most basic statistical analysis is descriptive analysis. Descriptive statistics can sum- 
marize responses from large numbers of respondents in a few simple statistics. When a sample is 
obtained, the sample descriptive statistics are used to make inferences about characteristics of the 
entire population of interest. This chapter introduces basic descriptive statistics, which are simple 
but powerful. This chapter also provides the foundation for Chapter 21, which will extend basic 
statistics into the area of univariate statistical analysis. 


The Nature of Descriptive Analysis 


Descriptive analysis is the elementary transformation of data in a way that describes the basic 
characteristics such as central tendency, distribution, and variability. For example, consider the 
business researcher who takes responses from 1,000 American consumers and tabulates their favor- 
ite soft drink brand and the price they expect to pay for a six-pack of that product. The mean, 
median, and mode for favorite soft drink and the average price across all 1,000 consumers would 
be descriptive statistics that describe central tendency in three different ways. Means, medians, 
modes, variance, range, and standard deviation typify widely applied descriptive statistics. 

Chapter 13 indicated that the level of scale measurement helps the researcher choose the most 
appropriate form of statistical analysis. Exhibit 20.1 shows how the level of scale measurement 
influences the choice of descriptive statistics. Remember that all statistics appropriate for lower- 
order scales (nominal and ordinal) are suitable for higher-order scales (interval and ratio), but the 
reverse is not true. 

Consider the following data. Sample consumers were asked where they most often purchased 
beer. The result is a nominal variable which can be described with a frequency distribution (see 
the bar chart in Exhibit 20.1). Ten percent indicated they most often purchased beer in a drug 
store, 45 percent indicated a convenience store, 35 percent indicated a grocery store, and 7 percent 
indicated a specialty store. Three percent listed some “other” outlet (not shown in the bar chart). 
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One item in the questionnaire 
asks respondents to report the 
career they view as most attrac- 
tive. A simple way to get an 
understanding of this population's 
career aspiration is to simply count the 
number who rank each profession as their preferred 
career. Try to draw some conclusions about which job 
is most attractive: (1) Calculate the number of respon- 
dents who rank each profession as the most attractive 
(assign it a 1). Report this tabulation. (2) Do you think 
female and male respondents respond similarly to this 
item? Try to create the appropriate cross-tabulation 
table to show which jobs are preferred by men and 
women respectively. 


Healthcare 
Finance 


information Technology 


The mode is convenience store since more respondents chose this than any other category. A 
similar distribution may have been obtained if the chart plotted the number of respondents ranking 
each store as their favorite type of place to purchase beer. 

The bottom part of Exhibit 20.1 displays example descriptive statistics for interval and ratio 
variables. In this case, the chart displays results of a question asking respondents how much they 
typically spend on a bottle of wine purchased in a store. The mean and standard deviation are 
displayed beside the chart as 11.7 and 4.5, respectively. Additionally, a frequency distribution is 
shown with a histogram. A histogram is a graphical way of showing a frequency distribution in 
which the height of a bar corresponds to the frequency of a category. Histograms are useful for any 


Measurement Level Statistic Example 


Beer Sales 
50 + => 


wd. 


Drug Store Convenience Store Grocery Store Specialty 


Purchase Location 


Frequency 


Mean = 11.6667 
Std. Dev. = 4.54888 
7 


5.00 10.00 15.00 20.00 25.00 
Price 


Internet & 100% r i 


histogram 


A graphical way of showing a 
frequency distribution in which 
the height of a bar corresponds 
to the observed frequency of the 
category. 


EXHIBIT 20.1 

Levels of Scale 
Measurement and 
Suggested Descriptive 
Statistics 
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tabulation 


The orderly arrangement of data 
in a table or other summary 
format showing the number of 
responses to each response cat- 


egory; tallying. 


frequency table 


A table showing the different 
ways respondents answered a 
question. 


cross-tabulation 


The appropriate technique for 
addressing research questions 
involving relationships among 
multiple less-than interval vari- 
ables; results in a combined 
frequency table displaying one 
variable in rows and another in 
columns. 
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type of data, but with continuous variables (interval or ratio) the histogram is useful for providing 
a quick assessment of the distribution of the data. A normal distribution line is superimposed over 
the histogram, providing an easy comparison to see if the data are skewed or multimodal. 


Tabulation 


Tabulation refers to the orderly arrangement of data in a table or other summary format. When this 
tabulation process is done by hand, the term tallying is used. Counting the different ways respon- 
dents answered a question and arranging them in a simple tabular form yields a frequency table. 
The actual number of responses to each category is a variable’s frequency distribution. A simple 
tabulation of this type is sometimes called a marginal tabulation. 

Simple tabulation tells the researcher how frequently each response occurs. This starting point 
for analysis requires the researcher to count responses or observations for each category or code 
assigned to a variable. A frequency table showing where consumers generally purchase beer can be 
computed easily. The tabular results that correspond to the chart would appear as follows: 


Cumulative 
Response Frequency Percent Percentage 
Drug store 50 10 10 
Convenience store 225 45 59 
Grocery store 175 35 90 
Specialty 35 7 97 
Other 15 3 100 


The frequency column shows the tally result or the number of respondents listing each store, 
respectively. The percent column shows the total percentage in each category. From this chart, we 
can see the most common outlet—the mode—is convenience store since more people indicated 
this as their top response than any other. The cumulative percentage keeps a running total, show- 
ing the percentage of respondents indicating this particular category and all preceding categories as 
their preferred place to purchase beer. The cumulative percentage column is not so important for 
nominal or interval data, but is quite useful for interval and ratio data, particularly when there are 
a large number of response categories. 

Similarly, a recent tabulation of Americans’ responses to the simple question of “Who is 
your favorite TV personality?” revealed the response varied by age. For respondents aged 18-24, 
Conan O’Brien was listed first. For respondents aged 30-39, Bill O’Reilly was the preferred TV 
personality, and among consumers 65 and older, Oprah Winfrey was the modal response.’ The 
idea that age influences choice of favorite celebrity brings us to cross-tabulation. 


Cross-Tabulation 


A frequency distribution or tabulation can address many research questions. As long as a 
question deals with only one categorical variable, tabulation is probably the best approach. 
Although frequency counts, percentage distributions, and averages summarize considerable 
information, simple tabulation may not yield the full value of the research. Cross-tabulation 
is the appropriate technique for addressing research questions involving relationships among 
multiple less-than interval variables. We can think of a cross-tabulation is a combined fre- 
quency table. Cross-tabs allow the inspection and comparison of differences among groups 
based on nominal or ordinal categories. One key to interpreting a cross-tabulation table is 
comparing the observed table values with hypothetical values that would result from pure 
chance. A statistical test for this comparison is discussed in Chapter 21. Here, we focus on 
constructing and interpreting cross-tabs. 
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Exhibit 20.2 summarizes several cross-tabulations from responses to a questionnaire on bonuses 
paid to American International Groups (AIG) executives and federal government bailouts in gen- 
eral.° Panel A presents results regarding how closely the respondents have followed the news stories 
regarding AIG executives receiving bonuses from the 2009 federal government bailout money. 
The cross-tab suggests this may vary with basic demographic variables. From the results, we can see 
that more men (60 percent) than women (51 percent) reported they “very closely” followed these 
news reports. Further, it appears that how closely one followed these news stories increases with age 
(from 41 percent of those 18—29 to 68 percent of those over 65). Panel B provides another example 
of a cross-tabulation table. The question asks if the respondents feel that most of the bailout money 
is going to those that created the crisis. In this case, we see very little difference between men 
(68 percent agree) and women (69 percent agree). However, before reaching any conclusions based 
on this survey, one must carefully scrutinize this finding for possible extraneous variables. 


EXHIBIT 20.2 Cross-Tabulation Tables from a Survey Regarding AIG and Government Bailouts 
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(A) Cross-Tabulation of Question “Have you followed the news stories about AIG bonuses?” 


Total Gender 
Adults Men Women 18-29 30-39 
Closely Followed News Stories Very closely 55% 60% 51% 41% 49% 
about AIG Bonuses? Somewhat closely 33% 30% 35% 37% 38% 
Not very closely 8% 7% 9% 20% 6% 
Not at all 2% 1% 4% 2% 4% 
Not sure 2% 2% 2% 0% 2% 


Age 
40-49 50-64 
52% 67% 68% 
39% 26% 22% 
4% 4% 5% 
2% 2% 1% 
3% 1% 3% 


(B) Cross-Tabulation of Question “Is the bailout money going to those that created the crisis?” 


Total Gender 
Adults Men Women 18-29 30-39 
Most Bailout Money Going Yes 68% 67% 69% 65% 76% 
to People Who Created Crisis? No 18% 23% 14% 27% 14% 
Not sure 14% 10% 17% 8% 10% 


Age 
40-49 50-64 
68% 70% 61% 
17% 16% 16% 
15% 14% 23% 


Source: Rasmussen Reports, National Survey of 1,000 Adults (March 17-18, 2009), http://www.rasmussenreports.com/premium_content/econ_crosstabs/march_2009/ 


crosstabs_aig_march_17_18_2009, accessed March 22, 2009. 


Contingency Tables 


Exhibit 20.3 on the next page shows example cross-tabulation results using contingency tables. 

A contingency table is a data matrix that displays the frequency of some combination of possible 

responses to multiple variables. Two-way contingency tables, meaning they involve two less-than 

interval variables, are used most often. A three-way contingency table involves three less-than 

interval variables. Beyond three variables, contingency tables become difficult to analyze and 

explain easily. For all practical purposes, a contingency table is the same as a cross-tabulation. 
Two variables are depicted in the contingency table shown in panel A: 


e Row Variable: Biological Sex M F 
e Column Variable: “Do you shop at Target? YES or NO” 


Several conclusions can be drawn initially by examining the row and column totals: 


1. 225 men and 225 women responded, as can be seen in the row totals column. 
Out of 450 total consumers responding, 330 consumers indicated that “yes” they do shop at 
Target and 120 indicated “no,” they do not shop at Target. This can be observed in the col- 
umn totals at the bottom of the table. These row and column totals often are called marginals 
because they appear in the table’s margins. 


Researchers usually are more interested in the inner cells of a contingency table. The inner 
cells display conditional frequencies (combinations). Using these values, we can draw some more 
specific conclusions: 


contingency table 


A data matrix that displays the 
frequency of some combination 
of possible responses to multiple 
variables; cross-tabulation results. 


marginals 


Row and column totals in a con- 
tingency table, which are shown 
in its margins. 
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EXHIBIT 20.3 
Possible Cross-Tabulations 
of One Question 


statistical base 


The number of respondents or 
observations (in a row or column) 
used as a basis for computing 
percentages. 
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(A) Cross-Tabulation of Question “Do you shop at Target?” 


by Sex of Respondent 
Yes 
Men 150 75 225 
Women 180 45 225 
Total 330 120 450 


(B) Percentage Cross-Tabulation of Question “Do you shop at Target?” 
by Sex of Respondent, Row Percentage 


Yes No 
Men 66.7% 33.3% 100% 
(225) 
Women 80.0% 20.0% 100% 
(225) 


(C) Percentage Cross-Tabulation of Question “Do you shop at Target?” 
by Sex of Respondent, Column Percentage 


Yes 
Men 45.5% 62.5% 
Women 54.5% 37.5% 
Total 100% 100% 
(Base) (330) (120) 


3. Out of 330 consumers who shop at Target, 150 are male and 180 are female. 
4. Alternatively, out of the 120 respondents not shopping at Target, 75 are male and 45 are 
female. 


This finding helps us know whether the two variables are related. If men and women equally 
patronized Target, we would expect that hypothetically 165 of the 330 shoppers would be female 
and 165 would be female. Because we have equal numbers of men and women, the 330 would 
be equally male and female. The hypothetical expectations (165m/165f) are not observed. What 
is the implication? Target shoppers are more likely to be female than male. Notice that the same 
meaning could be drawn by analyzing non-Target shoppers. The Research Snapshot on the next 
page provides an example of the information provided by cross-tabs. 

A two-way contingency table like the one shown in part A is referred to as a 2 X 2 table 
because it has two rows and two columns. Each variable has two levels. A two-way contingency 
table displaying two variables, one (the row variable) with three levels and the other with four 
levels, would be referred to as a 3 x 4 table. Any cross-tabulation table may be classified according 
to the number of rows by the number of columns (R by C). 


Percentage Cross-Tabulations 


When data from a survey are cross-tabulated, percentages help the researcher understand the nature 
of the relationship by making relative comparisons simpler. The total number of respondents or 
observations may be used as a statistical base for computing the percentage in each cell. When the 
objective of the research is to identify a relationship between answers to two questions (or two vari- 
ables), one of the questions is commonly chosen to be the source of the base for determining per- 
centages. For example, look at the data in parts A, B, and C of Exhibit 20.3. Compare part B with 
part C. In part B, we are considering gender as the base—what percentage of men and of women 
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l Contingent Personalities 
= ~ Whois the world’s favorite celebrity? 
This is an important question because 
the answer helps to determine how much a 
celebrity endorsement is worth. Sports stars 
like Tiger Woods are effective in shaping consumers’ product 
preferences worldwide. NBA player Tony Parker is wildly popu- 
lar in France, where he can be seen endorsing International 
Watch Company (IWC Schaffhausen) wristwatches. In China, 
actress Zhang Ziyi helps pitch Maybelline, Garnier, and Asience 
(Japanese shampoo brand). In other parts of the world, 
Aishwarya Rai could do the same thing. Perhaps some celebri- 
ties are effective nearly everywhere, but others may only be 
effective in a given country. Their effectiveness is contingent 
upon region. 
Television personalities also influence the public’s opin- 
ion by giving their own. But all opinions may not be equal. 
Polling agencies like the Harris interactive poll (http://www. 
harrisinteractive.com) monitor the popularity of celebrities. Who 
is America’s favorite television personality? Oprah Winfrey has 
achieved the top rating by Americans for several years. But 
is Oprah's likeability contingent upon other factors? Cross- 
tabulations can help answer this question. Consider the follow- 
ing 2-by-2 contingency table showing results of 1,000 respon- 
dents asked to choose whether they prefer Oprah Winfrey or 
David Letterman: 


Oprah David 
Winfrey Letterman Totals 
Men 150 350 500 
Women 380 120 500 


530 


470 1,000 


Or, consider the 3-by-3 contingency table: 


Oprah Bill Jon 
Winfrey O'Reilly Stewart Totals 
Conservatives 60 260 20 340 
Liberals 100 20 200 320 
Moderates 210 70 60 340 


370 350 280 1,000 


In either case, opinions about the preferred celebrity seem to 
be contingent, or to depend on some characteristic. Results like 
these would suggest that although Oprah is preferred overall, 
men prefer David Letterman over Oprah. Also, one’s favorite 
celebrity depends on political 
orientation. Thus, managers 
should consider the contin- 
gencies when trying to iden- 
tify preferred celebrities. 


Sources: Erdogan, B. Zater, Michael 

J. Baker, and Stephen Tagg, 

“Selecting Celebrity Endorsers: The 
Practitioner's Perspective,” Journal 

of Advertising Research 41 (May/ 

June 2001), 39-48; Goetzl, David 

and Wayne Friedman, “What We're 
Talking about,” Advertising Age 73 
(December 2, 2002), 51-57; “Harris 
Poll: Oprah Again Tops America’s List 
of Favorite TV Personalities,” Wall 
Street Journal Online, (February 3, 
2006), http://online.wsj.com/article/ 
SB113889692780763347.html; “IWC 
Schaffhausen Appoints Tony Parker as 
New Friend of the Brand,” PR Newswire 
(June 28 2007); Flannery, Russell, 
“Forbes China Celebrity List,” Forbes. 
com (March 18, 2009). 


shop at Target? In part C, we are considering Target shoppers as the base—what percentage of 
Target shoppers are men? Selecting either the row percentages or the column percentages will 
emphasize a particular comparison or distribution. The nature of the problem the researcher wishes 
to answer will determine which marginal total will serve as a base for computing percentages. 

Fortunately, a conventional rule determines the direction of percentages. The rule depends 
on which variable is identified as an independent variable and which is a dependent variable. 
Simply put, independent variables should form the rows in a contingency table. The marginal total of 
the independent variable should be used as the base for computing the percentages. Although sur- 
vey research does not establish cause-and-effect evidence, one might argue that it would be logi- 
cal to assume that a variable such as biological sex might predict beverage preference. This makes 
more sense than thinking that beverage preference would determine biological sex! 


Elaboration and Refinement 


The Oxford Universal Dictionary defines analysis as “the resolution of anything complex into its sim- 
plest elements.” Once a researcher has examined the basic relationship between two variables, he 
or she may wish to investigate this relationship under a variety of different conditions. Typically, a 
third variable is introduced into the analysis to elaborate and refine the researcher’s understanding 


—Percy Bysshe Shelley 
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elaboration analysis 


An analysis of the basic cross- 
tabulation for each level of a vari- 
able not previously considered, 
such as subgroups of the sample. 


EXHIBIT 20.4 
Cross-Tabulation of Marital 
Status, Sex, and Responses 
to the Question “Do You 
Shop at Target?” 


moderator variable 


A third variable that changes the 
nature of a relationship between 
the original independent and 
dependent variables. 
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by specifying the conditions under which the relationship between the first two variables is stron- 
gest and weakest. In other words, a more elaborate analysis asks, “Will interpretation of the rela- 
tionship be modified if other variables are simultaneously considered?” 

Elaboration analysis involves the basic cross-tabulation within various subgroups of the sample. 
The researcher breaks down the analysis for each level of another variable. If the researcher has 
cross-tabulated shopping preference by sex (see Exhibit 20.3) and wishes to investigate another 
variable (say, marital status), a more elaborate analysis may be conducted. Exhibit 20.4 breaks 
down the responses to the question “Do you shop at Target?” by sex and marital status. The data 
show women display the same preference whether married or single. However, married men are 
much more likely to shop at Target than are single men. The analysis suggests that the original 
conclusion about the relationship between sex and shopping behavior for women be retained. 
However, a relationship that was not discernible in the two-variable case is evident. Married men 
more frequently shop at Target than do single men. 


Married 


Men Women 


“Do you shop at Target?” 
Yes 55% 80% 86% 80% 


No 45% 20% 14% 20% 


The finding is consistent with an interaction effect. The combination of the two variables, sex 
and marital status, is associated with differences in the dependent variable. Interactions between 
variables examine moderating variables. A moderator variable is a third variable that changes the 
nature of a relationship between the original independent and dependent variables. Marital status 
is a moderator variable in this case. The interaction effect suggests that marriage changes the rela- 
tionship between sex and shopping preference. 

In other situations the addition of a third variable to the analysis may lead us to reject the 
original conclusion about the relationship. When this occurs, the elaboration analysis suggests the 
relationship between the original variables is spurious (see Chapter 3). 

The chapter vignette described data suggesting a relationship between the type of store in 
which a consumer shops and beverage preference. Convenience store shoppers seem to choose 
beer over wine, while grocery store shoppers choose wine over beer. Does store type drive drink- 
ing preference? Perhaps a third variable, age, determines both the type of store consumers choose 
to buy in and their preference for adult beverages. Younger consumers both disproportionately 
shop in convenience stores and drink beer. 


How Many Cross-Tabulations? 


Surveys may ask dozens of questions and hundreds of categorical variables can be stored in a 
data warehouse. Using computer programs, business researchers could “fish” for relationships 
by cross-tabulating every categorical variable with every other categorical variable. Thus, every 
possible response becomes a possible explanatory variable. A researcher addressing an exploratory 
research question may find some benefit in such a fishing expedition. Software exists that can 
automatically search through volumes of cross-tabulations. These may even provide some insight 
into the business questions under investigation. Alternatively, the program may flag the cross- 
tabulations suggesting the strongest relationship. CHAID (chi-square automatic interaction 
detection) software exemplifies software that makes searches through large numbers of variables 
possible.” Data-mining can be conducted in a similar fashion and may suggest relationships that are 
worth considering further. 

However, outside of exploratory research, researchers should conduct cross-tabulations that 
address specific research questions or hypotheses. When hypotheses involve relationships among 
two categorical variables, cross-tabulations are the right tool for the job. 
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Quadrant Analysis 


Quadrant analysis is a variation of cross-tabulation in which responses to two rating scale questions 
are plotted in four quadrants of a two-dimensional table. A common quadrant analysis in busi- 
ness research portrays or plots relationships between average responses about a product attribute’s 
importance and average ratings of a company’s (or brand’s) performance on that product feature. 
The term importance-performance analysis is sometimes used because consumers rate perceived 
importance of several attributes and rate how well the company’s brand performs on that attribute. 
Generally speaking, the business would like to end up in the quadrant indicating high performance 
on an important attribute. 

Exhibit 20.5 illustrates a quadrant analysis for an international, mid-priced hotel chain.* The 
chart shows the importance and the performance ratings provided by business travelers. After 
plotting the scores for each of eight attributes, the analysis suggests areas for improvement. The 
arrows indicate attributes that the hotel firm should concentrate on to move from quadrant three, 
which means the performance on those attributes is low but business consumers rate those attri- 
butes as important, to quadrant four, where attributes are both important and rated highly for 
performance. 


Prompt 
Service Room L Room 
Prices Cleanliness 


Quietness = F7 P> 


Breakfast 
Availability 
Attractive 


Interior Entertainment 


24-Hour 
Room Service 


Data Transformation 


Simple Transformations 


Data transformation (also called data conversion) is the process of changing the data from their origi- 
nal form to a format suitable for performing a data analysis that will achieve research objectives. 
Researchers often modify the values of scalar data or create new variables. For example, many 
researchers believe that less response bias will result if interviewers ask respondents for their year 
of birth rather than their age. This presents no problem for the research analyst, because a simple 
data transformation is possible. The raw data coded as birth year can easily be transformed to age 
by subtracting the birth year from the current year. 

In earlier chapters, we discussed recoding and creating summated scales. These also are com- 
mon data transformations. 

Collapsing or combining adjacent categories of a variable is a common form of data transfor- 
mation used to reduce the number of categories. A Likert scale may sometimes be collapsed into 
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quadrant analysis 


An extension of cross-tabulation 
in which responses to two rating- 
scale questions are plotted in 
four quadrants of a two- 
dimensional table. 


importance-performance 
analysis 


Another name for quadrant 
analysis. 


XHIBIT 20.5 
An Importance-Performance 
or Quadrant Analysis 
of Hotels 


data transformation 


Process of changing the data 
from their original form to a 
format suitable for performing a 
data analysis addressing research 
objectives. 


—Aristotle 
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EXHIBIT 20.6 
Bimodal Distributions 
Are Consistent with 
Transformations into 
Categorical Values 


median split 


Dividing a data set into two 
categories by placing respon- 
dents below the median in one 
category and respondents above 
the median in another. 
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a smaller number of categories. For instance, consider the following Likert item administered to a 
sample of state university seniors: 


Strongly Strongly 


Disagree Disagree Neutral Agree Agree 


l am satisfied with my college 
experience at this university 


The following frequency table describes results for this survey item: 


Strongly Strongly 


Disagree Disagree Neutral Agree 


110 30 15 35 210 


The distribution of responses suggests the responses are bimodal. That is, two “peaks” exist 
in the distribution, one at either end of the scale. Exhibit 20.6 shows an example of a bimodal 
distribution. Since the vast majority of respondents [80 percent = (110 + 210)/400] indicated 
either strongly disagree or strongly agree, the variable closely resembles a categorical variable. In 
general, customers either strongly disagreed or strongly agreed with the statement. So, the research 
may wish to collapse the responses into two categories. While multiple ways exist to accomplish 
this, the researcher may assign the value of one to all respondents who either strongly disagreed or 
disagreed and the value two to all respondents who either agreed or strongly agreed. Respondents 
marking neutral would be deleted from analysis. In this case, we would end up with 140 (110 + 30) 
respondents that disagree with this statement and 245 (210 + 35) that agreed. 
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Adapted from 1987 Nielsen Television Report. 


Problems with Data Transformations 


Researchers often perform a median split to collapse a scale with multiple response points into two 
categories. The median split means respondents below the observed median go into one category 
and respondents above the median go into another. Although this is common, the approach is 
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best applied only when the data do indeed exhibit bimodal characteristics. When the data are uni- 
modal, such as would be the case with normally distributed data, a median split will throw away 
valuable information and lead to error. 

Exhibit 20.7 illustrates this problem. Clearly, most respondents either slightly agree or slightly 
disagree with this statement. The central tendency could be represented by the median of 3.5, a mean 
of 3.5, and modes of 3 and 4 (3 and 4 each have the same number of responses). The “outliers,” 
if any, appear to be those not indicating something other than slight agreement/disagreement. A 
case can be made that the respondents indicating slight disagreement are more similar to those indi- 
cating slight agreement than they are to those respondents indicating strong disagreement. Yet we 
can see the recode places values 1 and 3 in the same new category, but places values 3 and 4 in a 
different category (see the recoding scheme in Exhibit 20.7). The data distribution does not support 
a median split into two categories and so a transformation collapsing these values into agreement 
and disagreement is inappropriate. 


EXHIBIT 20.7 The Problem with Median Splits with Unimodal Data 


Frequency Distribution: X, = | Do Most of My Shopping at 
Convenience Stores. 


Shop at Convenience Store 


Response Category (Code) Counts Cumulative Percentage 
140 Strongly Disagree (1) 10 2.86% 
Disagree (2) 40 14.29% 
120 4 Slightly Disagree (3) 125 50.00% 
Slightly Agree (4) 125 85.71% 
100 5 Agree (5) 40 97.14% 
a Strongly Agree (6) 10 100.00% 
o 
S 80 4 Median = 3.5 
> Recode to Complete Data Transformation: 
= 60-4 Old Values 1 2 3 5 
New Values 1 1 1 2 
407 
%4 Mean = 3.50 
Std. Dev. = 1.02616 
0 N = 350 


1.00 200 300 400 500 6.0 
Shop at Convenience Stores 


4 
Treated the Treated Treated the 
Same Differently Same 
Median (3.5) 


When a sufficient number of responses exist and a variable is ratio, the researcher may choose 
to delete one-fourth to one-third of the responses around the median to effectively ensure a 
bimodal distribution. However, median splits should always be performed only with great care, as 
the inappropriate collapsing of continuous variables into categorical variables ignores the informa- 
tion contained within the untransformed values. Rather than splitting a continuous variable into 
two categories to conduct a frequency distribution or cross-tabulation, we have more appropriate 
analytical techniques that are discussed in the chapters which follow. 
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index numbers 


Scores or observations re- 
calibrated to indicate how they 
relate to a base number. 


CHIBIT 20.8 
Hours of Television Usage 
per Week 
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Index Numbers 


The consumer price index and wholesale price index are secondary data sources that are frequently 
used by business researchers. Price indexes, like other index numbers, represent simple data trans- 
formations that allow researchers to track a variable’s value over time and compare a variable(s) 
with other variables. Recalibration allows scores or observations to be related to a certain base 
period or base number. 

Consider the information in Exhibit 20.8. Weekly television viewing statistics are shown 
grouped by household size. Index numbers can be computed for these observations in the follow- 
ing manner: 


1. A base number is selected. The U.S. household average of 52 hours and 36 minutes represents 
the central tendency and will be used. 

2. Index numbers are computed by dividing the score for each category by the base number and 
multiplying by 100. The index reflects percentage changes from the base: 


41:01 _ _ 
1 person hh: 52.36 0.7832 X 100 = 78.32 
47:58 _ _ 
2 person hh: 52.36 0.9087 X 100 = 90.87 
60:49 _ _ 
3+ person hh: 52.36 1.1553 X 100 = 115.53 
52:36 _ _ 
Total U.S. average: 52.36 1.0000 X 100 = 100.00 
1 41:01 
2 47:58 
3+ 60:49 
Total U.S. average 52:36 


Adapted from 1987 Nielsen Television Report. 


If the data are time-related, a base year is chosen. The index numbers are then computed 
by dividing each year’s activity by the base-year activity and multiplying by 100. Index numbers 
require ratio measurement scales. Managers may often chart consumption in some category over 
time. Relating back to the chapter vignette, grocers may wish to chart the U.S. wine consump- 
tion index. Using 1968 as a base year, the current U.S. wine consumption index is just over 2.0, 
meaning that the typical American consumer drinks about twice as much wine today as in 1968, 
which is just over 8.7 liters of wine per year.” The Research Snapshot on the next page shows 
another application of data transformation and index creation. 


Calculating Rank Order 


Survey respondents are often asked to rank order their preference for some item, issue, or char- 
acteristic. For instance, consumers may be asked to rank their three favorite brands or employee 
respondents may provide rankings of several different employee benefit plans. Ranking data can 
be summarized by performing a data transformation. The transformation involves multiplying the 
frequency by the ranking score for each choice to result in a new scale. 

For example, suppose a CEO had 10 executives rank their preferences for locations in which 
to hold the company’s annual conference. Exhibit 20.9 shows how executives ranked each of four 
locations: Hawaii, Paris, Greece, and Hong Kong. Exhibit 20.10 tabulates frequencies for these 
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h tgl. Twitter and the ReTweetability 
Index 
Twitter is one of the fastest growing 

social networks. A privately funded organization in 
San Francisco, Twitter's first prototype was devel- 
oped in March of 2006 and launched publicly five months later. 
Since then, Twitter has evolved into a real-time messaging service 
compatible with several different networks and multiple devices: 


Simplicity has played an important role in Twitter’s success. People 
are eager to connect with other people and Twitter makes that sim- 
ple. Twitter asks one question, “What are you doing?” Answers must 
be under 140 characters in length and can be sent via mobile texting, 
instant message, or the web. 

Twitter's core technology is a device agnostic message routing 
system with rudimentary social networking features. By accept- 
ing messages from sms, web, mobile web, instant message, or 
from third party API projects, Twitter makes it easy for folks to stay 
connected. 


If you are not familiar with Twitter, a basic understanding of 
the terminology is necessary. After signing up for a Twitter 
account, you can tweet your 140 character message. Followers 


Executive Hawaii Paris 
1 1 2 
2 1 3 
3 2 1 
4 2 4 
5 2 1 
6 3 4 
v 2 3 
8 1 4 
9 4 3 

10 2 1 


Destination 


Hawaii 3 5 
Paris 3 1 
Greece 2 2 
Hong Kong 2 2 


are people who have signed up to receive someone's Twitter 
messages. A retweet (or RT) occurs when a follower takes a 
tweet and then tweets that message to everyone in their own 
Twitter network. Encouraging other Twitter users to retweet 
your messages is the key in spreading your message across the 
Twittersphere. Wow! 

Dan Zarrella, a self-proclaimed viral marketing scientist, 
has developed an index to assess the most influential Twitter 
users. While several sites rank users by their number of follow- 
ers, and others report the number of RTs, Zarrella has combined 
these figures with the daily number of tweets to calculate the 
ReTweetability Index: 


(Retweets per Day / Tweets per Day) / Followers 


The index is intended to provide a score and ranking of Twitter 
users based on the power of their tweets. The higher the num- 
ber, the more influential Twitter you are! 


Sources: “About Twitter,” Twitter, http://twitter.com/about; Dan Zarrella’s 
ReTweetability Index, http://www.retweetability.com; Saric, Marko, “Make Your Blog 
Go Viral with Twitter ReTweets,” How to Make My Blog.com (January 13, 2009), 
http://www.howtomakemyblog.com/twitter/make-your-blog-go-viral-with-twitter- 
retweets. 


Greece Hong Kong Executive Rankings of 
Potential Conference 
4 3 Destinations 
4 2 
3 4 
3 1 
3 4 
1 2 
1 4 
2 3 
2 íl 
3 4 


Frequencies of Conference 
Destination Rankings 


3 3 
4 2 
2 4 
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rankings. A ranking summary can be computed by assigning the destination with the highest pref- 
erence the lowest number (1) and the least preferred destination the highest consecutive number 
(4). The summarized rank orderings were obtained with the following calculations: 


Hawaii: 3X 1)+(X2)+ (1X3) + (1 x 4) = 20 
Paris: (3X 1) + (1 X 2) + 3 X 3) + G X 4) = 26 
Greece: (2 X 1) + 2 X 2) + (4 X 3) + (2 X 4) = 26 
Hong Kong: (2 X 1) + (2 X 2) + (2 X 3) + (4 X 4) = 28 


Three executives chose Hawaii as the best destination (ranked “1”), five executives selected 
Hawaii as the second best destination, and so forth. The lowest total score indicates the first 
(highest) preference ranking. The results show the following rank ordering: (1) Hawaii, (2) Paris, 
(3) Greece, and (4) Hong Kong. Company employees may be glad to hear their conference will 
be in Hawaii! 


Tabular and Graphic Methods 
of Displaying Data 


Tables, graphs, and charts may simplify and clarify data. Graphical representations of data may take 
a number of forms, ranging from a computer printout to an elaborate pictograph. Tables, graphs, 
and charts, however, all facilitate summarization and communication. For example, see how the 
simple frequency table and histogram shown in Exhibit 20.7 provide a summary that quickly and 
easily communicates meaning that would be more difficult to see if all 350 responses were viewed 
separately. 

Today’s researcher has many convenient tools to quickly produce charts, graphs, or tables. 
Even common programs such as Excel and Word include chart functions that can construct the 
chart within the text document. Bar charts (histograms), pie charts, curve/line diagrams, and scat- 
ter plots are among the most widely used tools. Some choices match well with certain types of 
data and analyses. 

Bar charts and pie charts are very effective in communicating frequency tabulations and 
simple cross-tabulations. Exhibit 20.11 displays frequency data from the chapter vignette with 
pie charts. Each pie summarizes preference in the respective year. The size of each pie slice cor- 
responds to a frequency value associated with that choice. When the three pie charts are com- 
pared, the result communicates a cross-tabulation. Here, the comparison clearly communicates 


EXHIBIT 20.11 Pie Charts Work Well with Tabulations and Cross-Tabulations 


1992 Beverage Preference 


Other 
5% 


Wine 
27% 


Beer 
47% 


Spirits 
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2005 Beverage Preference 


Other 
4% 


Beer 
39% 


Spirits 
21% 


2008 Beverage Preference 


Beer 
42% 


Spirits 
23% 
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that wine preference increased at the expense of beer preference from 1992 to 2005, but has 
yielded some ground in 2008. In other words, the relative slice of pie for wine became larger, 
then slightly smaller. 

Chapter 25 discusses how these and other graphic aids may improve the communication value 
of a written report or oral presentation. 


Computer Programs for Analysis 


Statistical Packages 


Just 50 years ago, the thought ofa typical U.S. company performing even basic statistical analyses, 
like cross-tabulations, on a thousand or more observations was unrealistic. The personal computer 
brought this capability not just to average companies, but to small companies and individuals 
with limited resources. Today, computing power is very rarely a barrier to completing a research 
project. 

In the 1980s and early 1990s, when the PC was still a relatively novel innovation, special- 
ized statistical software formerly used on mainframe computers made their way into the personal 
computing market. Today, most spreadsheet packages can perform a wide variety of basic statisti- 
cal options. Excel’s basic data analysis tool will allow descriptive statistics including frequencies 
and measures of central tendency to be easily computed.'” Most of the basic statistical features 
are now menu driven, reducing the need to memorize function labels. Spreadsheet packages 
like Excel continue to evolve and become more viable for performing many basic statistical 
analyses. 

Despite the advances in spreadsheet applications, commercialized statistical software pack- 
ages remain extremely popular among researchers. They continue to become easier to use 
and more compatible with other data interface tools including spreadsheets and word proces- 
sors. Like any specialized tool, statistical packages are more tailored to the types of analyses 
performed by statistical analysts, including business researchers. Thus, any serious business 
or social science researcher should still become familiar with at least one general computer 
software package. 

Two of the most popular general statistical packages are SAS (http://www.sas.com) and SPSS 
(http://www.spss.com). SAS revenues exceed $2.15 billion in 2008 and its software can be found 
on computers worldwide. SAS was founded in 1976, and its statistical software historically has 
been widely used in engineering and other technical fields. SPSS stands for Statistical Package for 
the Social Sciences. SPSS was founded in 1968 and sales now exceed $300 million annually. SPSS 
is commonly used by university business and social science students. Business researchers have 
traditionally used SPSS more than any other statistical software tool. SPSS has been viewed as 
more “user-friendly” in the past. However, today’s versions of both SPSS and SAS are very user 
friendly and give the user the option of using drop-down menus to conduct analysis rather than 
writing computer code. 

Excel, SAS, and SPSS account for most of the statistical analysis conducted in business research. 
University students may also be exposed to MINITAB, which is sometimes preferred by econo- 
mists. However, MINITAB has traditionally been viewed as being less user-friendly than other 
choices. 

In the past, data entry was an issue as specific software required different types of data input. 
Today, however, all the major software packages, including SAS and SPSS, can work from data 
entered into a spreadsheet. The spreadsheets can be imported into the data windows or simply 
read by the program. Most conventional online survey tools will return data to the user in the 
form of either an SPSS data file, an Excel spreadsheet, or a plain text document. 

Exhibit 20.12 on the next page shows a printout of descriptive statistics generated by SAS for 
two variables: EMP (number of employees working in an MSA, or Metropolitan Statistical Area) 
and SALES (sales volume in dollars in an MSA) for 10 MSAs. The number of data elements (N), 
mean, standard deviation, and other descriptive statistics are displayed. SAS output is generally 
simple and easy to read. 
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EXHIBIT 20.12 SAS Computer Output of Descriptive Statistics 


State = NY Standard Minimum Maximum Std. Error 

Variable N Mean Deviation Value Value of Mean Variance 

EMP 10 142.930 232.665 12.800 788.800 13575 1429.300 54133.0 162.782 
SALES 10 5807.800 11905.127 307.000 39401.000 3764.732 58078.000 141732049.1 204.985 


Key: EMP = number of employees (000) SALES = Sales (000) 


EXHIBIT 20.13 
Examples of SPSS Output for 
Cross-Tabulation 


The thing to do is to 


supply light. 
—Woodrow Wilson 


As an example of SPSS output, the histograms shown in Exhibits 20.6 and 20.7 were 
created by SPSS. By clicking on “charts” in the SPSS tool menu, one can see the variety of 
charts that can be created. The key place to click to generate statistical results in tabular form 
is “analyze.” Here, one can see the many types of analysis that can be created. In this chapter, 
the choices found by clicking on “analyze” and then “descriptive statistics” are particularly 
relevant. 

Exhibit 20.13 shows an SPSS cross-tabulation of two variables, class status and smoking behav- 
ior. The data come from a sample intercepted on an urban university campus. It addresses the 
research question, “Does smoking on campus vary across groups?” More nonsmokers than smok- 
ers are found. However, the results show that graduate students, and to a lesser extent instructors, 
smoke more than the norm. The SPSS user can ask for any number of statistics and percentages to 
be included with this output by clicking on the corresponding options. 


CLASS * SMOKING Cross-Tabulation 
Smoking 


Smoker Non-Smoker 


Class high school 7 9 16 
undergraduate 9 22 31 
graduate 15 10 25 
career 6 6 12 
Total 37 47 84 


Computer Graphics and Computer Mapping 


Graphic aids prepared by computers have replaced graphic presentation aids drawn by artists. 
Computer graphics are extremely useful for descriptive analysis. As mentioned in Chapter 2, 
decision support systems can generate two- or three-dimensional computer maps to portray data 
about sales, demographics, lifestyles, retail stores, and other features. Exhibit 20.14 shows a com- 
puter graphic depicting how fast-food consumption varies from state to state. The chart shows the 
relative frequencies of eating fast-food burgers, chicken, tacos, or other types of fast food across 
several states. Computer graphics like these have become more common as common applica- 
tions have introduced easy ways of generating 3-D graphics and maps. Many computer maps are 
used by business executives to show locations of high-quality customer segments. Competitors’ 
locations are often overlaid for additional quick and easy visual reference. Scales that show miles, 
population densities, and other characteristics can be highlighted in color, with shading, and with 
symbols. 
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Fast Food Consideration 


i 80-90 
70-80 
i 60-70 
Œ 50-60 
E 40-50 
E 30-40 
Bi 20-30 
E 10-20 
0-10 


04- | | 1 T 


Louisiana Colorado Ohio Kansas Arizona 


Many computer programs can draw box and whisker plots, which provide graphic represen- 
tations of central tendencies, percentiles, variabilities, and the shapes of frequency distributions. 
Exhibit 20.15 shows a computer-drawn box and whisker plot for 100 responses to a question mea- 
sured on a 10-point scale. The response categories are shown on the vertical axis. The small box 
inside the plot represents responses for half of all respondents. Thus, half of respondents marked 4, 
5, or 6. This gives a measure of variability called the interquartile range, but the term midspread is 
less complex and more descriptive. The location of the line within the box indicates the median. 
The dashed lines that extend from the top and bottom of the box are the whiskers. Each whisker 
extends either the length of the box (the midspread in our example is 2 scale points) or to the most 
extreme observation in that direction. 

An outlier is a value that lies outside the normal range of the data. In Exhibit 20.15 on the next page 
outliers are indicated by either a 0 or an asterisk. Box and whisker plots are particularly useful for 
spotting outliers or comparing group categories (e.g., men versus women). 


Interpretation 


An interpreter at the United Nations translates a foreign language into another language to 
explain the meaning of a foreign diplomat’s speech. In business research, the interpretation 
process explains the meaning of the data. After the statistical analysis of the data, inferences and 
conclusions about their meaning are developed. 

A distinction can be made between analysis and interpretation. Interpretation is drawing infer- 
ences from the analysis results. Inferences drawn from interpretations lead to managerial implica- 
tions. In other words, each statistical analysis produces results that are interpreted with respect 
to insight into a particular decision. The logical interpretation of the data and statistical analysis 
are closely intertwined. When a researcher calculates a cross-tabulation of employee number of 
dependents with choice of health plan, an interpretation is drawn suggesting that employees with 
a different number of dependents may be more or less likely to choose a given health place. This 
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EXHIBIT 20.14 

A 3-D Graph Showing Fast- 
Food Consumption Patterns 
around the United States 


box and whisker plots 


Graphic representations of 
central tendencies, percentiles, 
variabilities, and the shapes of 
frequency distributions. 


interquartile range 


A measure of variability. 


outlier 


A value that lies outside the nor- 
mal range of the data. 


interpretation 


The process of drawing infer- 
ences from the analysis results. 
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Computer Drawn Box and 
Whisker Plot 
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Potential Outliers 


Potential Outliers 
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75th percentile 6.00 
25th percentile 4.00 
Standard deviation 1.62 


From “Graphic Displays of Data: Box and Whisker Plots,’ Reports No. 17, Market Facts, Inc. 


interpretation of the statistical analysis may lead to a realization that certain health plans are better 
suited for different family situations. 

From a management perspective, however, the qualitative meaning of the data and their 
managerial implications are an important aspect of the interpretation. Consider the crucial role 
played by interpretation of research results in investigating one new product, a lip stain that could 
color the lips a desired shade semi-permanently and last for about a month at a time: 


The lip stain idea, among lipstick wearers, received very high scores on a rating scale ranging from “excel- 
lent” to “poor,” presumably because it would not wear off. However, it appeared that even among 
routine wearers of lipstick the idea was being rated highly more for its interesting, even ingenious, nature 
than for its practical appeal to the consumer’s personality. They liked the idea, but for someone else, not 
themselves. . . . [Careful interpretation of the data] revealed that not being able to remove the stain for 
that length of time caused most women to consider the idea irrelevant in relation to their own personal 
needs and desires. Use of the product seems to represent more of a “permanent commitment” than is usu- 
ally associated with the use of a particular cosmetic. In fact, women attached overtly negative meaning to 
the product concept, often comparing it with hair dyes instead of a long-lasting lipstick." 


This example shows that interpretation is crucial. However, the process is difficult to explain 
in a textbook because there is no one best way to interpret data. Many possible interpretations of 
data may be derived from a number of thought processes. Experience with selected cases will help 
you develop your own interpretative ability. 

Data are sometimes merely reported and not interpreted. Research firms may provide reams 
of computer output that do not state what the data mean. At the other extreme, some researchers 
tend to analyze every possible relationship between each and every variable in the study. Such an 
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A 
a 


e A frequency table can bea very useful © A continuous variable that displays a bimodal distribution is 


way to depict basic tabulations. appropriate for a median split. 


e Cross-tabulation and contingency tables e Median splits on continuous variables displaying a normal 


are a simple and effective way to examine rela- 
tionships among less than interval variables. 
e When a distinction can be made between inde- 
pendent and dependent variables (that are nominal or 


ordinal), the convention is rows are independent variables inconsistent classifications. 
and columns are dependent variables. e Box and whisker plots can reveal outliers. 
e Importance-performance charts are a good way to illustrate e Outliers can distort statistical analysis. Therefore, they 


market positioning by showing where brands are strong or 
weak on important variables. A weakness on an important 
variable is a call to action. 


approach is a sign that the research problem was not adequately defined prior to beginning the 
research and the researcher really doesn’t know what business decision the research is addressing. 
Researchers who have a clear sense of the purpose of the research do not request statistical analysis 
of data that have little or nothing to do with the primary purpose of the research. 


Summary 


1. Know what descriptive statistics are and why they are used. Descriptive analyses provide descrip- 
tive statistics including measures of central tendency and variation. Statistics such as the mean, 
mode, median, range, variance, and standard deviation are all descriptive statistics. These statistics 
provide a summary describing the basic properties of a variable. 


2. Create and interpret simple tabulation tables. Statistical tabulation is another way of saying that 
we count the number of observations in each possible response category. In other words, tabula- 
tion is the same as tallying. Tabulation is an appropriate descriptive analysis for less-than interval 
variables. Frequency tables and histograms are used to display tabulation results. 


3. Understand how cross-tabulations can reveal relationships. Cross-tabulation is when we com- 
bine two or more less-than interval variables to display the relationship. For example, a cross- 
tabulation of respondent gender with adult beverage preference (i.e., beer, spirits, wine) would 
give us two rows (male and female) and three columns (beer, spirits, wine), which would show 
the preferred beverage for each gender. The key to interpreting a cross-tabulation result is to 
compare actual observed values with hypothetical values that would result from pure chance. 
When observed results vary from these values, a relationship is indicated. 


4. Perform basic data transformations. Data transformations are often needed to assist in data 
analysis and involve changing the mathematical form of data in some systematic way. Basic data 
transformations include reverse coding, summating scales, creating index numbers, and collapsing 
a variable based on a median split. 


5. List different computer software products designed for descriptive statistical analysis. While 
spreadsheets have improved with respect to their ability to conduct basic statistical analyses, busi- 
ness researchers still rely heavily on specialized statistical software. SAS and SPSS are two of the 
best known statistical packages. Each is available for even the most basic modern PC and can be 
used with a drop-down window interface, practically eliminating the need for writing computer 
code. 


6. Understand a researcher’s role in interpreting the data. The interpretation process explains 
the meaning of the data. Interpretation is drawing inferences from the analysis results; provid- 
ing meaning for the figures which are observed. Inferences drawn from interpretations lead to 
managerial implications. 


become candidates for deletion. 


distribution are typically not appropriate and result in 

a loss of information. If necessary, these should only be 
performed after deleting one-fourth to one-third of the 
responses around the median to help prevent logically 
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Key Terms and Concepts 


box and whisker plots, 501 histogram, 487 moderator variable, 492 
contingency table, 489 importance-performance analysis, 493 outlier, 501 
cross-tabulation, 488 index numbers, 496 quadrant analysis, 493 
data transformation, 493 interpretation, 501 statistical base, 490 
descriptive analysis, 486 interquartile range, 501 tabulation, 488 
elaboration analysis, 492 marginals, 489 

frequency table, 488 median split, 494 


Questions for Review and Critical Thinking 


1. What are five descriptive statistics used to describe the basic properties of variables? 
What is a histogram? What is the advantage of overlaying a normal distribution over a histogram? 

3. A survey asks respondents to respond to the statement “My work is interesting.” Interpret the frequency distribution shown here (taken 
from an SPSS output): 
a. My work is interesting: 


Category Abs. Rel. Freq. Adj. Freq. Cum. Freq. 
Label Code Freq. (Pct.) (Pct.) (Pct.) 
Very true 1 650 23.9 62.4 62.4 
Somewhat true 2 303 11.2 29.1 91.5 
Not very true 3 61 2.2 59 97.3 
Not at all true 4 28 1.0 2.7 100.0 
Total 2,715 100.0 100.0 
Valid cases 1,042 Missing cases 1,673 


4. Use the data in the following table to 
a. Prepare a frequency distribution of the respondents’ ages 
b. Cross-tabulate the respondents’ genders with cola preference 
c. Identify any outliers 


Cola Weekly Unit 
Individual Gender Age Preference Purchases 
James M 19 Coke 2 
Parker M 17 Pepsi 5 
Bill M 20 Pepsi 7 
Laurie F 20 Coke 2 
Jim M 18 Coke 4 
Jil F 16 Coke 4 
Tom M 17 Pepsi 12 
Julia F 22 Pepsi 6 
Amie F 20 Pepsi 2 
Dawn F 19 Pepsi 3 


5. Data on the average size of a soda (in ounces) at all 30 major league baseball parks are as follows: 14, 18, 20, 16, 16, 12, 14, 16, 14, 16, 16, 
16, 14, 32, 16, 20, 12, 16, 20, 12, 16, 16, 24, 16, 16, 14, 14, 12, 14, 20. Compute descriptive statistics for this variable including a box 
and whisker plot. Comment on the results. 

6. The following computer output shows a cross-tabulation of frequencies and provides frequency number N) and row R) percentages. 

a. Interpret this output including a conclusion about whether or not the row and column variables are related. 


Chapter 20: Basic Data Analysis: Descriptive Statistics 


b. Critique the way the analysis is presented. 
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c. Draw a pie chart indicating percentages for having read a book in the past three month for those with and those without high 


school diplomas. 


Have You Read 
a Book in Past 


Have High School Diploma? 


3 Months? Yes 
Yes 489 
73.8 
No 473 
55.6 
TOTAL 962 


7. List and describe at least three basic data transformations. 


oe 


No Total 
174 663 
26.2 

378 851 
44.4 

552 1,514 


What conditions suggest that a ratio variable should be transformed (recoded) into a dichotomous (two group) variable? 


9. A data processing analyst for a research supplier finds that preliminary computer runs of survey results show that consumers love a 
client’s new product. The employee buys a large block of the client’s stock. Is this ethical? 


Research Activities 


1. ‘NET Go the Web site for the Chicago Cubs baseball team 
(http://chicago.cubs.mlb.com). Use either the schedule listing or 
the stats information to find their record in the most recent 
season. Create a data file with a variable indicating whether 
each game was won or lost and a variable indicating whether 
the game was played at home in Wrigley Field or away from 
home. Using computerized software like SPSS or SAS, 

a. Compute a frequency table and histogram for each variable. 

b. Use cross-tabulations to examine whether a relationship 
exists between where the game is played (home or away) 
and winning. 


c. Extra analysis: Repeat the analyses for the Houston Astros 
baseball team (http://houston.astros.mlb.com). What does this 
suggest for the relationship between playing at home and 
winning? 

2. ‘NET Go to http://www.spss.com and click on Industries and 
Market Research. What services does the company provide? 


Case 20.1 Body on Tap 
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A few years ago Vidal Sassoon, Inc., took legal 
action against Bristol-Myers over a series of TV 
commercials and print ads for a shampoo that 
had been named Body on Tap because of its beer 
- content." The prototype commercial featured 

| a well-known high fashion model saying, “In 


PHOTODISC GREEN 


shampoo tests with over 900 women like me, Body on Tap got 
higher ratings than Prell for body. Higher than Flex for condition- 
ing. Higher than Sassoon for strong, healthy-looking hair.” 

The evidence showed that several groups of approximately 
200 women each tested just one shampoo. They rated it on a 
six-step qualitative scale, from “outstanding” to “poor,” for 27 
separate attributes, such as body and conditioning. It became 
clear that 900 women did not, after trying both shampoos, make 
product-to-product comparisons between Body on Tap and 
Sassoon or between Body on Tap and any of the other brands 
mentioned. In fact, no woman in the tests tried more than one 
shampoo. 

The claim that the women preferred Body on Tap to Sassoon 
for “strong, healthy-looking hair” was based on combining the data 
for the “outstanding” and “excellent” ratings and discarding the 
lower four ratings on the scale. The figures then were 36 percent 


for Body on Tap and 24 percent (of a separate group of women) for 
Sassoon. When the “very good” and “good” ratings were combined 
with the “outstanding” and “excellent” ratings, however, there was 

only a difference of 1 percent between the two products in the cat- 

egory of “strong, healthy-looking hair.” 

The research was conducted for Bristol-Myers by Marketing 
Information Systems, Inc. (MISI), using a technique known as 
blind monadic testing. The president of MISI testified that this 
method typically is employed when what is wanted is an abso- 
lute response to a product “without reference to another specific 
product.” Although he testified that blind monadic testing was 
used in connection with comparative advertising, that was not 
the purpose for which Bristol-Myers retained MISI. Rather, 
Bristol-Myers wished to determine consumer reaction to the 
introduction of Body on Tap. Sassoon’s in-house research expert 
stated flatly that blind monadic testing cannot support compara- 
tive advertising claims. 


Question 

Comment on the professionalism of the procedures used to make 
the advertising claim. Why do you believe the researchers per- 
formed the data transformations described? 
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Case 20.2 Downy-Q Quilt 


The research for Downy-Q is an example of a Method 
commercial test that was conducted when an : Pte. i 
ző advertising campaign for an established brand had Brand choices tow the same individuals were obtained before 
ae run its course. The revised campaign, “Fighting and after viewing the commercial. The commercial was tested 
= 8 the Cold,” emphasized that Downy-Q was an in 30-second, color-moving, storyboard form in a theater test. 
8 = “extra-warm quilt”; previous research had dem- Invited viewers were shown programming with commercial inserts. 


onstrated that extra warmth was an important and Qualified respondents were women who had bought quilts in 
outlets that carried Downy-Q. The results are shown in Case 


Exhibits 20.2-1 through 20.2-4. 


deliverable product quality. The commercial test was requested to 
measure the campaign’s ability to generate purchase interest. 
The marketing department had recommended this revised adver- 


tising campaign and was now anxious to know how effectively this Question 


commercial would perform. The test concluded that “Fighting the Interpret the data in these tables. What recommendations and con- 


: : i = ? 
Cold” was a persuasive commercial. It also demonstrated that the clusions would you offer to Downy-Q management? 


new campaign would have greater appeal to specific market segments. 


Shifts in Brand Choice before and after Showing of 
Downy-Q Quilt Commercial 


Question: We are going to give away a sample of fabric softener. You can select the 
brand you most prefer. Which brand would you chose? 


Brand Choice 
after Commercial (%) 


Brand Choice Downy-Q Other Brand 
before Commercial (n = 23) (n = 237) 
Downy-Q 78 19 
Other brand 22 81 


Pre/Post Increment in Choice of Downy-Q 


Improvement in score based on exposure to commercial. 


“Fighting Norm: All Quilt 
the Cold” Commercials 
Demographic Group Base Score Average Range 
Total audience (260) ar 115) +10 6-19 
By marital status 
Married (130) 17 
Not married (130) +12 
By age 
Under 35 (130) +14 
35 and over (130) iS 
By employment status 
Not employed (90) +13 
Employed (170) +18 
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CASE EXHIBIT 20.2-3 Adjective Checklist for Downy-Q Quilt Commercial 


Question: Which of these words do you feel come closest to describing the 
commercial you've just seen? (Check all the apply.) 


“Fighting Norm: All Quilt 
the Cold” Commercials 

Adjective 

Positive 
Appealing 18 24 
Clever 11 40 
Convincing 20 14 
Effective 19 23 
Entertaining 5) 24 
Fast moving 12 21 
Genuine 7 4 
Imaginative 7 21 
Informative 24 18 
Interesting ils} 17 
Original 7 20 
Realistic 8 3 
Unusual 3 8 

Negative 
Amateurish 9 11 
Bad Taste 4 4 
Dull 33 20 
Repetitious 17 16 
Silly 8 19 
Slow 8 7 
Unbelievable 3 5 
Unclear 3 2 
Unimportant 14 14 
Uninteresting 32 19 


CASE EXHIBIT 20.2-4 Product Attribute Checklist for Downy-Q 


Question: Which of the following statements do you feel apply to Downy-Q? (Mark 
as many or as few as you feel apply.) 


“Fighting the Cold” 


Attributes 

Extra warm 56 
Lightweight 48 
Pretty designs 45 
Durable fabrics 28 
Nice fabrics 27 


Good construction 27 


CHAPTER 21 
UNIVARIATE 
STATISTICAL 


ANALYSIS 
After studying this chapter, you should be able to 
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1. Implement the hypothesis-testing procedure 

2. Use p-values to test for statistical significance 

3. Test a hypothesis about an observed mean compared to 
some standard 

4. Know the difference between Type I and Type Il errors 

5. Know when a univariate x? test is appropriate and how to 


conduct one 


Chapter Vignette: Well, Are They Satisfied or Not? 

Ross has worked for PrecisionMetals for six years, but had really only served as an analyst for 
the production facility. This was the first corporate-level opportunity to showcase his research 
skills. His corporate contact was David Green, who currently served as Chief Operations Officer 
for PrecisionMetals. David had specifically asked to meet with him about the satisfaction survey 


conducted a month ago. 
“Ross, we continue to worry about losing metalwork employees at our Madison plant, 


but our Richmond plant seems to be OK in terms of turnover,” David stated. “What is your 
take on our employee satisfaction?” Ross replied, “We put together an 

index of three questions that asked about job 

satisfaction. We have analyzed 


the data from the Madison 
plant, and our average satisfac- 

tion is 3.9” David asked, “What 

does 3.9 mean? How am | sup- 

posed to understand that?” Ross 
responded, “I’m sorry, | should 

have explained this better. We 

asked the employees on a scale 
with five categories, with ‘1’ mean- 
ing ‘Strongly Disagree, and ‘5’ 
meaning ‘Strongly Agree. When the 
scores were averaged for Madison, 
our overall satisfaction was 3.9.” 
David continued, “Is that good or 
bad? Sounds OK I guess. And what 
about Richmond?” Ross, realizing that 
he was not communicating the infor- 
mation well, responded, “Our satisfac- 
tion score from last year for both plants 
was 3.5. We can certainly check on this.” 


David realized that Ross was getting flustered. It was time to reassure him. “Ross, l'm sorry 
but | don’t know what the scores mean. If 3.5 was a good score for us last time, then great. 


| just want to know if the new survey shows they are more satisfied or not.” 
Ross went back to the research section, with two things on his mind. “I've got to compare the 


last satisfaction score with the new score,’ he thought. And as he walked into his office and shut 
the door quietly he said to himself, “I can’t just speak about scores. I’m here to help them under- 


stand what the scores really mean.” It was time to get to work. 
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Chapter 21: Univariate Statistical Analysis 


Introduction 


Empirical testing typically involves inferential statistics. This means that an inference will be drawn 
about some population based on observations of a sample representing that population. Statistical 
analysis can be divided into several groups: 


e Univariate statistical analysis tests hypotheses involving only one variable. 

e Bivariate statistical analysis tests hypotheses involving two variables. 

e Multivariate statistical analysis tests hypotheses and models involving multiple (three or more) 
variables or sets of variables. 


The focus in this chapter is on univariate statistics. Thus, we examine statistical tests appropriate for 
drawing inferences about a single variable. In the chapter vignette, the COO was interested in the 
satisfaction of a plant, compared to what it was a year ago. This could represent an opportunity to 
test hypotheses about a single variable—in this case job satisfaction. The survey data regarding job 
satisfaction will be analyzed and tested against a benchmark of 3.5. 


Hypothesis Testing 


Descriptive research and causal research designs often climax with hypothesis tests. Hypotheses are 
defined as formal statements of explanations stated in a testable form. Generally, hypotheses should 
be stated in concrete fashion so that the method of empirical testing seems almost obvious. Types 
of hypotheses tested commonly in business research include the following: 


1. Relational hypotheses—examine how changes in one variable vary with changes in another. 
This is usually tested by assessing covariance in some way, very often with regression analysis. 


iS) 


Hypotheses about differences between groups—examine how some variable varies from one 
group to another. These types of hypotheses are very common in causal designs. 

3. Hypotheses about differences from some standard—examine how some variable differs from 
some preconceived standard. The preconceived standard sometimes represents the true value 
of the variable in a population. These tests can involve either a test of a mean for better-than 
ordinal variables or a test of frequencies if the variable is ordinal or nominal. These tests typify 
univariate statistical tests. 


The Hypothesis-Testing Procedure 
PROCESS 


Hypotheses are tested by comparing the researcher’s educated guess with empirical reality. The 
process can be described as follows: 


1. First, the hypothesis is derived from the research objectives. The hypothesis should be stated as 
specifically as possible. 

2. Next, a sample is obtained and the relevant variable is measured. 

3. The measured value obtained in the sample is compared to the value either stated explicitly 
or implied in the hypothesis. If the value is consistent with the hypothesis, the hypothesis is 
supported. If the value is not consistent with the hypothesis, the hypothesis is not supported. 


A univariate hypothesis consistent with the chapter vignette would be 
H,: The average satisfaction at the Madison plant is greater than 3.5. 


If the average job satisfaction is 3.4, the hypothesis is not supported. If the average job satisfaction 
is 3.9, the hypothesis is supported. 

Univariate hypotheses are typified by tests comparing some observed sample mean against 
a benchmark value. The test addresses the question, Is the sample mean truly different from 
the benchmark? But how different is really different? If the observed sample mean is 3.45 
and the benchmark is 3.50, would the hypothesis still be supported? Probably not! When the 
observed mean is so close to the benchmark, we do not have sufficient confidence that a second 
set of data using a new sample taken from the same population might not produce a finding 
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univariate statistical analysis 


Tests of hypotheses involving 
only one variable. 


bivariate statistical analysis 


Tests of hypotheses involving 
two variables. 


multivariate statistical 
analysis 


Statistical analysis involving 
three or more variables or sets of 
variables, 


COURTESY OF QUALTRICS.COM 


Hypothesis testing is often a critical part of what business ilo 
researchers do for the organization. It is particularly important 

to understand how data you gather compare to benchmarks set 

by your work group, your firm, or even your industry. Here is a 

short exercise that will help you understand the importance of 2; 
this analysis. 


Select two variables for the survey (job perfor- 
mance characteristics, customer satisfaction, 
etc.) that could serve as a possible benchmark 
for a firm. 

Using a frequencies distribution of both 
variables, identify the mean and standard 

deviation of both variables. 

3. Develop a hypothesis statement for both 
variables. 

4. Conduct a hypothesis test for both variables, 
setting your benchmark value to the scale 
midpoint. 

5. Notice and comment on the significance of these 
tests for both variables. What do the results tell 
you? 


Is your supervisor concerned with the benefits package for his/her employees? 


significance level 


A critical probability associated 
with a statistical hypothesis 

test that indicates how likely an 
inference supporting a difference 
between an observed value 

and some statistical expectation 
is true. The acceptable level of 
Type | error. 


p-value 


Probability value, or the observed 
or computed significance level; 
p-values are compared to signifi- 
cance levels to test hypotheses. 


510 


conflicting with the benchmark. In contrast, when the mean turns out well above 3.5, perhaps 
3.9, then we could more easily trust that another sample would not produce a mean equal to 
or less than 3.5. 

In statistics classes, students are exposed to hypothesis testing as a contrast between a null and 
an alternative hypothesis. A “null” hypothesis can be thought of as the expectation of findings as if 
no hypothesis existed (i.e.,“no” or “null” hypothesis). In other words, the state implied by the null 
hypothesis is the opposite of the state represented by the actual hypothesis. A null to the hypothesis 
listed in the Research Snapshot on the next page is 


H: The average number of pounds gained in the freshman year is equal to 7.8 (not greater than). 


The alternative hypothesis states the opposite of the null, which normally conforms to one of the 
common types of relationships above. So, the researcher’s hypothesis is generally stated in the form 
of an “alternative” hypothesis. Are you confused? 

While this terminology is common in statistical theory, the idea of a null hypothesis can 
be confusing. Therefore, the use of the term null hypothesis will be avoided when at all possible. The 
reader should instead focus on what the findings should look like if the proposed hypothesis is true. 
If the hypothesis above is true, an observed sample’s mean should be noticeably greater than (or in 
our case less than) 7.8. We test to see if this idea can be supported by the empirical evidence. 

Empirical evidence is provided by test results comparing the observed mean against some 
sampling distribution. The variance in observations also plays a role because with greater variance, 
there is more of a chance that the range of values includes 7.8. A statistical test’s significance level 
or p-value becomes a key indicator of whether or not a hypothesis can be supported. 


SIGNIFICANCE LEVELS AND p-VALUES 


A significance level is a critical probability associated with a statistical hypothesis test that indicates 
how likely it is that an inference supporting a difference between an observed value and some statisti- 
cal expectation is true. The term p-value stands for probability-value and is essentially another name 
for an observed or computed significance level. Exhibit 21.1 on page 512 discusses interpretations of 
p-values in different kinds of statistical tests. The probability in a p-value is that the statistical expecta- 
tion (null) for a given test is true. So, low p-values mean there is little likelihood that the statisti- 
cal expectation is true. This means the researcher’s hypothesis positing (suggesting) a difference 
between an observed mean and a population mean, or between an observed frequency and a popu- 
lation frequency, or for a relationship between two variables, is likely supported. 
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| ba The “Freshman 7.8” 
There is a common belief that when 
college freshman students start their 
first semester away from their families, they gain 
15 pounds in the first year. Commonly referred to as 
the “Freshman 15; few research studies have actually examined if this 
extra 15 pounds actually appears. In fact, this belief is so prevalent 
that at an annual meeting of the Obesity Society, the current gen- 
eration of college students were referred to as “Generation XL.’ 
Researchers at Purdue University conducted a study of 
freshman-year weight gain, using 907 freshman students. Their 
results were consistent with another study at Brown University. 
For both universities, freshman students gained between 6 and 
8 pounds, with the Purdue average being 7.8 pounds. Male 
students were more likely to gain weight than female students. 
Clearly, students were gaining weight. Many of them placed the 
blame on their newfound freedom. It was just too easy to eat 
whatever and whenever they wanted. However, it appears that 
the belief that new students experience the “Freshman 15” was 
actually quite a bit higher than reality. 
As a test, we asked a freshman class for their own weight 
gain. Granted, it was certainly a subjective assessment, and 
students were not weighed before or after they started their 


The test is conducted with 46 male and female students with 
the results shown below: 


Std. Error 
N Mean Std. Deviation Mean 
Students 46 5.63 25 0.369 


Was the self-reported weight gain of these students support- 

ive of the hypothesis? The univariate statistic testing this result 
suggests the answer to this question is no. The p-value for this 
test is less than 0.0001, which supports the premise that the 
mean number of pounds gained is less than 7.8 pounds. It cer- 
tainly suggests that the “Freshman 15” should lose a few pounds. 


Test Value = 7.8 


95% Confidence 
Interval of the 
Difference 
p-value Mean 
T df (2-tailed) Difference Lower Upper 
Pounds —5.86 45 0.000 = 266 —2.911 NA] 


Sources: Hellmich, Nancy, “Freshman 
15 Drops Some Pounds,’ USA Today 
(October 23, 2006), accessed April 23, 
2009. 


university education. But it does allow for a hypothesis test: 
Given the results of the Purdue University study, do students gain 
7.8 pounds in their first year of school? 
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Traditionally, researchers have specified an acceptable significance level for a test prior to the 
analysis. Later, we will discuss this as an acceptable amount of Type I error. For most applications, 
the acceptable amount of error, and therefore the acceptable significance level, is 0.1, 0.05, or 0.01. 
If the p-value resulting from a statistical test is less than the pre-specified significance level, then a 
hypothesis about differences is supported. 

Consider an example where researchers have identified that a successful restaurant should have 
families with an average of 1.4 children within a 10-minute drive of their location. Exhibit 21.2 
on the next page illustrates an important property of p-values. In this case, the comparison standard 
of 1.4 is shown as an orange line. The sample result is shown as an orange line (3.1). The normal 
curve illustrates what other sample results would likely be. What is most important to realize is 
that as the observed value gets further from 1.4, the p-value gets smaller, meaning that the chance 
of the mean actually equaling 1.4 also is smaller. With the observed mean of 3.1 and the observed 
standard deviation of 1.02, there is very little chance that the researcher would be wrong in 
concluding the actual number of children per family is greater than 1.4. 

Consider the test in the Research Snapshot above. The statistical test is whether or not the 
mean computed from the 46 observations is different from 7.8. Given the risk associated with 
being wrong, the researcher uses an acceptable significance level of 0.05. After computing the 
appropriate test, the research observes a computed significance level or p-value that is less than 
0.001. Therefore, the hypothesis is supported. 

In discussing confidence intervals, statisticians use the term confidence level, or confidence coef- 
ficient, to refer to the level of probability associated with an interval estimate. However, when 
discussing hypothesis testing, statisticians change their terminology and call this a significance level, 
a (the Greek letter alpha). 
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p-Values and Statistical 
Tests 


As the observed mean gets 
further from the standard 
(proposed population 
mean), the p-value 
decreases. The lower the 
p-value, the more confidence 
you have that the sample 
mean is different. 


Part 6: Data Analysis and Presentation 


Test Description 


Test Statistic 


Compare an Observed 
Mean with Some 
Predetermined Value 


Zor étest—Low p-values Indicate 
the Observed Mean Is Different 
Than Some Predetermined Value 
(Often 0) 


Compare an Observed 
Frequency with a 
Predetermined Value 


X?—Low p-values Indicate 
That Observed Frequency Is 
Different Than Predetermined 
Value 


Compare an Observed 
Proportion with Some 
Predetermined Value 


Zor ttest for Proportions—Low 
p-values Indicate That the 
Observed Proportion Is Different 
Than the Predetermined Value 


Bivariate Tests: 


Compare Whether Two 
Observed Means Are Different 
from One Another. 


Zor ttest—Low p-values 
Indicate the Means Are Different 


Compare Whether Two 
Less-Than Interval Variables Are 
Related Using Cross-tabs 


X?—Low p-values Indicate the 
Variables Are Related to One 
Another 


Compare Whether Two Interval 
or Ratio Variables Are Correlated 
to One Another 


ttest for Correlation—Low 
p-values Indicate the Variables 
Are Related to One Another 


Frequency 


Mean = 3.0684 
Std. Dev. = 1.01793 
N = 68 


0.5 


Children 


0.000001 


0.001 0.00001 


Chapter 21: Univariate Statistical Analysis 


An Example of Hypothesis Testing 


The example described here illustrates the conventional statistical approach to testing a univariate 
hypothesis with an interval or ratio variable. Suppose the Pizza-In restaurant is concerned about 
store image before deciding whether to expand. Pizza-In managers are most interested in how 
friendly customers perceive the service to be. A sample of 225 customers was obtained and asked 
to indicate their perceptions of service on a five-point scale, where 1 indicates “very unfriendly” 
service and 5 indicates “very friendly” service. The scale is assumed to be an interval scale, and 
experience has shown that the previous distribution of this attitudinal measurement assessing the 
service dimension was approximately normal. 

Now, suppose Pizza-In believes the service has to be different from 3.0 before a decision about 
expansion can be made. In conventional statistical terminology, the null hypothesis for this test is 
that the mean is equal to 3.0: 


A: b= 3.0 
The alternative hypothesis is that the mean does not equal 3.0: 
H: u # 3.0 


More practically, the researcher is likely to write the substantive hypothesis (as it would be stated 
in a research report or proposal) something like this: 


H: Customer perceptions of friendly service are significantly greater than three. 


Note that the substantive hypothesis matches the “alternative” phrasing. In practical terms, research- 
ers do not state null and alternative hypotheses. Only the substantive hypothesis implying what is 
expected to be observed in the sample is formally stated. 

Next, the researcher must decide on a significance level. This level corresponds to a region of 
rejection on a normal sampling distribution as shown in Exhibit 21.1.The peak of the distribu- 
tion is the theoretical expected value for the population mean. In this case it would be three. If 
the acceptable significance level is 0.05, then the 0.025 on either side of the mean that is furthest 
away from the mean forms the rejection zone (shaded orange in Exhibit 21.1). The values within 
the unshaded area are called acceptable at the 95 percent confidence level (or 5 percent significance level, 
or 0.05 alpha level), and if we find that our sample mean lies within this region we conclude that 
the means are not different from the expected value, 3 in this case. More precisely, we fail to reject 
the null hypothesis. In other words, the range of acceptance (1) identifies those acceptable values 
that reflect a difference from the hypothesized mean in the null hypothesis and (2) shows the range 
within which any difference is so minuscule that we would conclude that this difference was due 
to random sampling error rather than to a false null hypothesis. H, would not be supported. 

In our example, the Pizza-In restaurant hired research consultants who collected a sample of 
225 interviews. The mean friendliness score on a five-point scale equaled 3.78. (If © is known, it is 
used in the analysis; however, this is rarely true and was not true in this case.') The sample standard 
deviation was S = 1.5. Now we have enough information to test the hypothesis. 

The researcher has decided that the acceptable significance level will be set at 0.05. This means 
that the researcher wishes to draw conclusions that will be erroneous 5 times in 100 (0.05) or 
fewer. From the table of the standardized normal distribution, the researcher finds that the Z score 
of 1.96 represents a probability of 0.025 that a sample mean will be above 1.96 standard errors from 
p. Likewise, the table shows that 0.025 of all sample means will fall below —1.96 standard errors 
from u. Adding these two “tails” together, we get 0.05. 

The values that lie exactly on the boundary of the region of rejection are called critical values 


of u. Theoretically, the critical values are Z = —1.96 and +1.96. Now we must transform these crit- 
ical Z-values to the sampling distribution of the mean for this image study. The critical values are 
a ee S 
Critical value — lower limit = u — ZS% . : j= Lr 
= 3.0 — 1.96 = | 
| V 225 
= 3.0 — 1.96(.1) 
= 3.0 — 0.196 


= 2.804 
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critical values 


The values that lie exactly on 
the boundary of the region of 
rejection. 
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EXHIBIT 21.3 
A Hypothesis Test Using the 
Sampling Distribution of X 
under the Hypothesis 

H = 3.0 
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Critical value — upper limit = u + ZS% or p+ ZS 
15 
= 3.0 + 196|] 
3.0 + 1.96 | 755 
= 3.0 + 1.96(.1) 
= 3.0 + 0.196 
= 3.196 


Based on survey results, the sample mean (X) is 3.78.The sample mean is contained in the region 
of rejection (see the dark shaded areas of Exhibit 21.3). Since the sample mean is greater than the 
critical value of 3.196, falling in one of the tails (regions of rejection), the researcher concludes that 
the sample result is statistically significant beyond the 0.05 level. A region of rejection means that 
the thought that the observed sample mean equals the predetermined value of 3.0 will be rejected 
when the computed value takes a value within the range. Here is another way to express this result: 
If we took 100 samples from this population and the mean were actually 3.0, fewer than five will 
show results that deviate this much. 


2.804 3.0 3.196 I A 
A A A A 
Critical Hypothesized Critical X from 
Value— u Value— Sample 
Lower Limit Upper Limit 


What does this mean to the management of the Pizza-In? The results indicate that custom- 
ers believe the service is pretty friendly. The probability is less than 5 in 100 that this result (X = 
3.78) would occur because of random sampling error. This suggests that friendliness of the service 
personnel may not be problem. However, perhaps Pizza-In should compare its friendliness rat- 
ing with the friendliness rating of a key competitor. That analysis will have to wait until we cover 
bivariate tests. 

An alternative way to test the hypothesis is to formulate the decision rule in terms of the 
Z-statistic. Using the following formula, we can calculate the observed value of the Z-statistic 
given a certain sample mean, (X): 


Xp 
Zas = Sx 
_ 3.78 = jl 
= a 
_ 3.78 — 3.0 
af, 
ae 
1 
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In this case, the Z-value is 7.8 and we find that we have met the criterion of statistical significance 
at the 0.05 level. This result produces a p-value of 0.000001. Once again, since the p-value is less 
than the acceptable significance level, the hypothesis is supported. The service rating is significantly 
higher than 3.0.This example used the conventional statistical terminology involving critical val- 
ues and a statistical null hypothesis. Once again, it is rare that researchers have to look up tabled 
values for critical values anymore since the statistical packages will usually return a p-value for a 
given test. Thus, the p-value, or a confidence interval associated with the p-value, is the key to 
interpretation. 


Type I and Type II Errors 


Hypothesis testing using sample observations is based on probability theory. We make an observa- 
tion of a sample and use it to infer the probability that some observation is true within the popula- 
tion the sample represents. Because we cannot make any statement about a sample with complete 
certainty, there is always the chance that an error will be made. When a researcher makes the 
observation using a census, meaning that every unit (person or object) in a population is measured, 
then conclusions are certain. Researchers very rarely use a census. 

The researcher using sampling runs the risk of committing two types of errors. Exhibit 21.4 
summarizes the state of affairs in the population and the nature of Type I and Type II errors. The 
four possible situations in the exhibit result because the null hypothesis (using the example above, 
u = 3.0) is actually either true or false and the observed statistics (X = 3.78) will result in accep- 


tance or rejection of this null hypothesis. 


Decision 
Actual State in the Population Accept H, Reject H, 
H, is true Correct—no error Type | error 
H, is false Type Il error Correct—no error 
TYPE | ERROR 


Suppose the observed sample mean described above leads to the conclusion that the mean is 
greater than 3.0 when in fact the true population mean is equal to 3.0. A Type l error has occurred. 
A Type I error occurs when a condition that is true in the population is rejected based on statis- 
tical observations. When a researcher sets an acceptable significance level a priori a he or she is 
determining tolerance for a Type I error. Simply put, a Type I error occurs when the researcher 
concludes that there is a statistical difference when in reality one does not exist. When testing for 
relationships, a Type I error occurs when the researcher concludes a relationship exists when in fact 
one does not exist. 


TYPE Il ERROR 


If the alternative condition is in fact true (in this case the mean is not equal to 3.0) but we conclude 
that we should not reject the null hypothesis (accept that the mean is equal to 3.0), we make what 
is called a Type II error. A Type II error is the probability of failing to reject a false null hypothesis. 
This incorrect decision is called beta (8). In practical terms, a Type II error means that we fail to 
reach the conclusion that some difference between an observed mean and a benchmark exists 
when in fact the difference is very real. In terms of a bivariate correlation, a Type II error would 
mean the idea that a relationship exists between two variables is rejected when in fact the relation- 
ship does indeed exist. The Research Snapshot on the next page provides further clarification of 
the Type I and Type II conditions. 
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EXHIBIT 21.4 
Type I and Type Il 
Errors in Hypothesis Testing 


4 


—Sophocles 


Type | error 


An error caused by rejecting 
the null hypothesis when it is 
true; has a probability of alpha. 
Practically, a Type | error occurs 
when the researcher concludes 
that a relationship or difference 
exits in the population when in 
reality it does not exist. 


Type Il error 


An error caused by failing to 
reject the null hypothesis when 
the alternative hypothesis is 

true; has a probability of beta. 
Practically, a Type Il error occurs 
when a researcher concludes 
that no relationship or difference 
exists when in fact one does exist. 
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The Law and Type I and innocent until proven guilty. Assume that 


Type Il Errors the null hypothesis is that the individual 

Although most attorneys is innocent. If we make a Type | error, we 

and judges do not concern will send an innocent person to prison. 

themselves with the statisti- Our legal system takes many precautions to 

cal terminology of Type | and avoid Type | errors. A Type Il error would occur if 

Type Il errors, they do fol- a guilty party were set free (the null hypothesis would have been 
low this logic. For example, accepted). Our society places such a high value on avoiding Type | 
our legal system is based on errors that Type Il errors are more likely to occur. 


the concept that a person is 


Unfortunately, without increasing sample size the researcher cannot simultaneously reduce 
Type I and Type II errors. They are inversely related. Thus, reducing the probability of a Type II 
error increases the probability of a Type I error. In marketing problems, Type I errors generally are 
considered more serious than Type II errors. Thus more emphasis is placed on determining the 
significance level, a, than in determining B.? 


Choosing the Appropriate Statistical Technique 


Numerous statistical techniques are available to assist the researcher in interpreting data. Choosing 
the right tool for the job is just as important to the researcher as to the mechanic. Making the cor- 
rect choice can be determined by considering 


The type of question to be answered 
The number of variables involved 


aa 


The level of scale measurement 


Today, the researcher rarely has to perform a paper and pencil calculation. Hypotheses are 
tested by using a correct click-through sequence in a statistical software package. The mathematics 
of these packages is highly reliable. Therefore, if the researcher can choose the right statistic, know 
the right click-through sequence, and read the output that results, the right statistical conclusion 
should be easy to reach. 


Type of Question to Be Answered 


The type of question the researcher is attempting to answer is a consideration in the choice of 
statistical technique. For example, a researcher may be concerned simply with the central tendency 
of a variable or with the distribution of a variable. Comparison of different business divisions’ sales 
results with some target level will require a one-sample t-test. Comparison of two salespeople’s 
average monthly sales will require a t-test of two means, but a comparison of quarterly sales distri- 
butions will require a chi-square test. 

The researcher should consider the method of statistical analysis before choosing the research 
design and before determining the type of data to collect. Once the data have been collected, the 
initial orientation toward analysis of the problem will be reflected in the research design. 


Number of Variables 


The number of variables that will be simultaneously investigated is a primary consideration in the 
choice of statistical technique. A researcher who is interested only in the average number of times 
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( Living ina Statistical Web 


ELECTRONIC ENCYCLOPEDIA OF STATISTICAL EXAMPLES 


= “Having trouble learning statistical con- AND EXERCISES 
cepts? Do a little surfing and the con- http://www.stat.ohio-state.edu/~eesee/ 
cepts may become clear. Many sources exist that The Electronic Encyclopedia of Statistical Examples and 
illustrate statistical problems and provide data for Exercises is a resource for the study of statistics that includes 
practice. Here are just a few: real-world examples of the uses and abuses of statistics and 
STATLIB statistical inference. 
http://lib.stat.cmu.edu/ THE RICE VIRTUAL LAB IN STATISTICS 
StatLib is a system for distributing statistical software, data http://onlinestatbook.com/rvis.html 
sets, and information by electronic mail, FTP, and the World http://davidmlane.com/hyperstat/ 
Wide Web. The Rice Virtual Lab in Statistics provides hypertext materials 
STAT-HELP such as HyperStat Online. 
http://www.stat-help.com/ STATCRUNCH 
Stat-Help.com provides help with statistics via the Inter- http://www.statcrunch.com/ 
net and contains spreadsheets for performing many basic Stat-Crunch is a statistical software package via the World 
calculations. Wide Web. 
SURFSTAT.AUSTRALIA GRAPHPAD 
http://surfstat.anu.edu.au/surfstat-home/surfstat-main.html http://www.graphpad.com/ 
SurfStat.australia is an online text in introductory statis- quickcalcs/Statratiol.cfm 
tics from the University of Newcastle and the Australian GraphPad software is a 
government. 


p-value calculator. 


a prospective home buyer visits financial institutions to shop for interest rates can concentrate 
on investigating only one variable at a time. However, a researcher trying to measure multiple 
complex organizational variables cannot do the same. Simply put, univariate, bivariate, and mul- 
tivariate statistical procedures are distinguished based on the number of variables involved in an 
analysis. 


Level of Scale of Measurement 


The scale measurement level helps choose the most appropriate statistical techniques and appropri- 
ate empirical operations. Testing a hypothesis about a mean, as we have just illustrated, is appro- 
priate for interval scaled or ratio scaled data. Suppose a researcher is working with a nominal scale 
that identifies users versus nonusers of bank credit cards. Because of the type of scale, the researcher 
may use only the mode as a measure of central tendency. In other situations, where data are mea- 
sured on an ordinal scale, the median may be used as the average or a percentile may be used as a 
measure of dispersion. For example, ranking brand preferences generally employs an ordinal scale. 
Nominal and ordinal data are often analyzed using frequencies or cross-tabulation. 


Parametric versus Nonparametric Hypothesis Tests 


The terms parametric statistics and nonparametric statistics refer to the two major groupings of 
statistical procedures. The major distinction between them lies in the underlying assumptions about 
the data to be analyzed. Parametric statistics involve numbers with known, continuous distribu- 
tions. When the data are interval or ratio scaled and the sample size is large, parametric statistical 
procedures are appropriate. Nonparametric statistics are appropriate when the numbers do not 
conform to a known distribution. 

Parametric statistics are based on the assumption that the data in the study are drawn from 
a population with a normal (bell-shaped) distribution and/or normal sampling distribution. For 
example, if an investigator has two interval-scaled measures, such as gross national product (GNP) 


parametric statistics 


Involve numbers with known, 
continuous distributions; whe 
the data are interval or ratio 
scaled and the sample size is 


n 


large, parametric statistical proce- 


dures are appropriate. 


nonparametric statistics 


Appropriate when the variables 


being analyzed do not confor 
to any known or continuous 
distribution. 


m 
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and industry sales volume, parametric tests are appropriate. Possible statistical tests might include 
product-moment correlation analysis, analysis of variance, regression, or a t-test for a hypothesis 
about a mean. 

Nonparametric methods are used when the researcher does not know how the data are distrib- 
uted. Making the assumption that the population distribution or sampling distribution is normal 
generally is inappropriate when data are either ordinal or nominal. Thus, nonparametric statistics 
are referred to as distribution free.* Data analysis of both nominal and ordinal scales typically uses 
nonparametric statistical tests. 

Exhibit 21.5 illustrates how an appropriate univariate statistical method can be selected. The 
exhibit illustrates how statistical techniques vary according to scale properties and the type of ques- 
tion being asked. More univariate statistical tests exist than are shown in Exhibit 21.5, but these 
basic options address the majority of univariate analyses in marketing research. A complete discus- 
sion of all univariate techniques is beyond the scope of this text. 


EXHIBIT 21.5 Univariate Statistical Choice Made Easy 


Interval or 
Ratio 


Is sample mean 
different from 


hypothesized value? 


Zest or Hest 


t-test 


A hypothesis test that uses the 
t-distribution. A univariate t-test 
is appropriate when the variable 

being analyzed is interval or ratio. 


The t-Distribution 


A univariate t-test is appropriate for testing hypotheses involving some observed mean against some 
specified value. The t-distribution, like the standardized normal curve, is a symmetrical, bell-shaped 
distribution with a mean of 0 and a standard deviation of 1.0. When sample size (n) is larger than 
30, the t-distribution and Z-distribution are almost identical. Therefore, while the t-test is strictly 
appropriate for tests involving small sample sizes with unknown standard deviations, researchers 
commonly apply the t-test for comparisons involving the mean of an interval or ratio measure. The 
precise height and shape of the t-distribution vary with sample size. More specifically, the shape of 
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the t-distribution is influenced by its degrees of freedom (df). The degrees of freedom are deter- 
mined by the number of distinct calculations that are possible given a set of information. In the case 
of a univariate t-test, the degrees of freedom are equal to the sample size (n) minus one. 

Exhibit 21.6 illustrates t-distributions for 1, 2,5, and an infinite number of degrees of freedom. 
Notice that the t-distribution approaches a normal distribution rapidly with increasing sample size. 
This is why, in practice, marketing researchers usually apply a t-test even with large samples. The 
practical effect is that the conclusion will be the same since the distributions are so similar with 
large samples and the correspondingly larger numbers of degrees of freedom. 


0.40 ~ 
O35 |r 
0.30 |- 
025 = 
0.20 |- 


WS = 


Relative Frequency 


0.10 = 


WS F 


0.00 


Values of t 


Another way to look at degrees of freedom is to think of adding four numbers together when 
you know their sum—for example, 


The value of the fourth number has to be 
5. The values of the first three digits could 
change to any value (freely vary), but the 
fourth value would have to be determined 
for the mean to still equal to 12. In this 
example there are three degrees of free- 


dom. Degrees of freedom can be a diffi- 
cult concept to understand fully. For most 
basic statistical analyses, the user only needs 
to remember the rule for determining the 
number of degrees of freedom for a given 
test. Today, with computerized software 
packages, even that number is provided 
automatically for most tests. 
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t-distribution 


Asymmetrical, bell-shaped dis- 
tribution that is contingent on 
sample size; has a mean of 0 and 
a standard deviation equal to 1. 


degrees of freedom (df) 


The number of observations 
minus the number of constraints 
or assumptions needed to calcu- 
late a statistical term. 


EXHIBIT 21.6 
The t-Distribution for 
Various Degrees of Freedom 


Ultra-luxury car makers 
have sales goals that may 
involve selling 1,000 cars 
per year or fewer worldwide. 
What questions are asked in 
marketing a car like this that 
might involve a univariate 
analysis?* 
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The calculation of t closely resembles the calculation of the Z-value. To calculate t, use the 
formula 
X-u 
Sx 


t= 


with n — 1 degrees of freedom. 

The Z-distribution and the t-distribution are very similar, and thus the Z-test and t-test will 
provide much the same result in most situations. However, when the population standard deviation 
(©) is known, the Z-test is most appropriate. When o is unknown (the situation in most market- 
ing research studies), and the sample size greater than 30, the Z-test also can be used. When Ø is 
unknown and the sample size is small, the t-test is most appropriate. Since the two distributions are 
similar with larger sample sizes, the two tests often yield the same conclusion. 


Calculating a Confidence Interval Estimate Using 
the t-Distribution 


Suppose a business organization is interested in finding out how long newly hired MBA graduates 
remain on their first jobs. On the basis of a small sample of employees with MBAs, the researcher 
wishes to estimate the population mean with 95 percent confidence. The data from the sample are 
presented below. 


Number of years on firstjob: 3 5 7 1 12 1 2 2 5 
423 1 3 42 67 


To find the confidence interval estimate of the population mean for this small sample, we use 
the formula 


w= xX ae ta. Sz 
or 
Upper limit = X+ tul) 
Lower limit = X — a 
where 
H = population mean 
(X) = sample mean 


tı = critical value of t at a specified confidence level 
Sz = standard error of the mean 

S = sample standard deviation 

n = sample size 


More specifically, the step-by-step procedure for calculating the confidence interval is as follows: 


1. We calculate (X) from the sample. Summing our data values yields $X = 70,and (X) = {X/n = 
70/18 = 3.89. 

2. Since o is unknown, we estimate the population standard deviation by finding S, the sample 
standard deviation. For our example, S = 2.81. 

3. We estimate the standard error of the mean using the formula Sy = S/\/n. Thus, Sx = 
2.81/V18 or Sx = 0.66. 

4. We determine the t-values associated with the desired confidence level. To do this, we go to 
Table A.3 in the appendix. Although the t-table provides information similar to that in the 
Z-table, it is somewhat different. The t-table format emphasizes the chance of error, or signifi- 
cance level (q), rather than the 95 percent chance of including the population mean in the esti- 
mate. Our example is a two-tailed test. Since a 95 percent confidence level has been selected, 
the significance level equals 0.05(1.00 — 0.95 = 0.05). Once this has been determined, all 
we have to do to find the f-value is look under the 0.05 column for two-tailed tests at the row 
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in which degrees of freedom (df) equal the appropriate value (n — 1). Below 17 degrees of 
freedom (n — 1 = 18 — 1 = 17), the t-value at the 95 percent confidence level (0.05 level of 
significance) is £ = 2.12. 

5. We calculate the confidence interval: 


Lower limit = 3.89 — 2.12 ta = 2.49 


2 
Upper limit = 3.89 + 2.12 Fee 


= 5.28 


In our hypothetical example it may be concluded with 95 percent confidence that the population 
mean for the number of years spent on the first job by MBAs is between 2.49 and 5.28. 


ONE- AND TWO-TAILED t-TESTS 


Univariate Z-tests and t-tests can be one- or two-tailed. A two-tailed test is one that tests for dif- 
ferences from the population mean that are either greater or less. Thus, the extreme values of the 
normal curve (or tails) on both the right and the left are considered. In practical terms, when a 
research question does not specify whether a difference should be greater than or less than, a two- 
tailed test is most appropriate. For instance, the following research question could be examined 
using a two-tailed test: 


The number of take-out pizza restaurants within a postal code in Germany is not equal to 5. 


A one-tailed univariate test is appropriate when a research hypothesis implies that an observed 
mean can only be greater than or less than a hypothesized value. Thus, only one of the “tails” of the 
bell-shaped normal curve is relevant. For instance, the following hypothesis could be appropriately 
examined with a one-tailed test: 


H,: The number of pizza restaurants within a postal code in Florida is greater than five. 


In this case, if the observed value is significantly less than five, the hypothesis is still not supported. 
Practically, a one-tailed test can be determined from a two-tailed test result by taking half of the 
observed p-value. When the researcher has any doubt about whether a one- or two-tailed test is 
appropriate, he or she should opt for the less conservative two-tailed test. Most computer software 
will assume a two-tailed test unless otherwise specified. 


Univariate Hypothesis Test Using the t-Distribution 


The step-by-step procedure for a t-test is conceptually similar to that for hypothesis testing with 
the Z-distribution. Suppose a Pizza-In store manager believes that the average number of custom- 
ers who return a pizza or ask for a refund is 20 per day. The store records the number of returns 
and exchanges for each of the 25 days it was open during a given month. Are the return/complaint 
observations different than 20 per day? The substantive hypothesis is 


H; p # 20 


1. The researcher calculates a sample mean and standard deviation. In this case, X = 22 and S 
(sample standard deviation) = 5. 
2. The standard error is computed (Sx): 


= 1 


3. The researcher then finds the t-value associated with the desired level of confidence level or 
statistical significance. Ifa 95 percent confidence level is desired, the significance level is 0.05. 
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chi-square (x?) test 


One of the basic tests for statisti- 
cal significance that is particularly 
appropriate for testing hypoth- 
eses about frequencies arranged 
in a frequency or contingency 
table. 


goodness-of-fit (GOF) 


A general term representing how 
well some computed table or 
matrix of values matches some 
population or predetermined 
table or matrix of the same size. 
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4. The critical values for the t-test are found by locating the upper and lower limits of the confidence 


interval. The result defines the regions of rejection. This requires determining the value of t. For 
24 degrees of freedom (n = 25, df= n — 1), the tvalue is 2.064. The critical values are 


Lower limit = u 


Upper limit = u + tu, Sẹ = 20 + 2.064 vod 
1) 


la Sy = 20 — 2.064| Fz] 
= 20 — 2.064(1) 
= 17.936 


= 20 + 2.064 
= 22.064 


Finally, the researcher makes the statistical decision by determining whether the sample mean falls 


between the critical limits. For the pizza store sample, X = 22. The sample mean is not included 


in the region of rejection. Even though the sample result is only slightly less than the critical value 


at the upper limit, the null hypothesis cannot be rejected. In other words, the pizza store manager’s 


assumption appears to be correct. 


As with the Z-test, there is an alternative way to test a hypothesis with the t-statistic. This is 


by using the formula 


obs 


We can see that the observed t-value is less than the critical value of 2.064 at the 0.05 level when 
there are 25 — 1 = 24 degrees of freedom. As a result, the p-value is greater than 0.05 and the hypoth- 


esis is not supported. We cannot conclude with 95 percent confidence that the mean is not 20. 


The Chi-Square Test for Goodness of Fit 


A chi-square (x?) test is one of the most basic tests for statistical significance and is particularly 


appropriate for testing hypotheses about frequencies arranged in a frequency or contingency table. 


Univariate tests involving nominal or ordinal variables are examined with a x”. More generally, the 
x” test is associated with goodness-of-fit (GOF). GOF can be thought of as how well some matrix 
(table) of numbers matches or fits another matrix of the same size. Most often, the test is between 


a table of observed frequency counts and another table of expected values (central tendency) for 


those counts. 


Consider the following hypothesis that relates back to the chapter vignette: 


H,: Papa John’s Pizza stores are more likely to be located in a stand-alone location than in a shopping 


center. 


A competitor may be interested in this hypothesis as part of the competitor analysis in a market- 


ing plan. A researcher for the competitor gathers a random sample of 100 Papa John’s locations in 


California (where the competitor is located). The sample is selected from phone directories and 


the locations are checked by having an assistant drive to each location. The following observations 


are recorded in a frequency table. 


Location 


One-Way Frequency Table 


Stand-Alone 
Shopping Center 


Total 


60 stores 


40 stores 


100 stores 
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These observed values (O,) can be compared to the expected values for this distribution (E) to 
complete a x? test. The x? value will reflect the likelihood that the observed values come from a 
distribution reflected by the expected values. The higher the value of the x? test, the less likely it is 
that the expected and observed values are the same. 

In statistical terms, a x” test determines whether the difference between an observed frequency 
distribution and the corresponding expected frequency distribution is due to sampling variation. 
Computing a x? test is fairly straightforward and easy. Students who master this calculation should 
have little trouble understanding future significance tests since the basic logic of the x” test under- 
lies these tests as well. 

The steps in computing a x? test are as follows: 


1. Gather data and tally the observed frequencies for the categorical variable. 
Compute the expected values for each value of the categorical variable. 

3. Calculate the x’ value, using the observed frequencies from the sample and the expected 
frequencies. 

4. Find the degrees of freedom for the test. 

5. Make the statistical decision by comparing p-value associated with the calculated x’ against the 
predetermined significance level (acceptable Type I error rate). 


These steps can be illustrated with the pizza store location example. 


e The data for the location variable (stand-alone or shopping center) are provided in the fre- 
quency table on page 522. 

e The next step asks, “What are the expected frequencies for the location variable? This is 
another way of asking the central tendency for each category. Since the sample size is 100, find- 
ing the expected values is easy. If no pattern exists in the locations, they should be distributed 
randomly across the two categories. We would expect that half (50) of the locations would be 
stand-alone and half (50) would be in a shopping center. This is another way of saying that the 
expected probability of being one type of location is 50 percent. The expected values also can 
be placed in a frequency table: 


Stand-Alone 100/2 = 50 stores 
Shopping Center 100/2 = 50 stores 
Total 100 stores 


e The actual x’ value is computed using the following formula: 
2 (O, — Ey 
CHS E 


i 


X? = chi-square statistic 


O 
II 


observed frequency in the ith cell 


ty 
| 


= expected frequency in the ith cell 
Sum the squared differences: 

nacn se) 
x E E 


i 2 


Thus, we determine that the chi-square value equals 4: 


, _ (60 — 50)? u- 50)? 
X= 50 50 


=4 
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Interested in Retirement? It Often Depends on Your Age 
Chi-square tests are used often in business research. Consider 

a business that sponsors a program to educate employees on 
retirement issues. They need to plan the number and types of 
activities that should be the focus of the training and develop- The x’ value can be computed as shown 
ment seminars. One question is whether or not an equal number below: 

of younger versus older employees will come to the sessions. 


— = 2 ne 2 
They decide to observe the relative frequencies of younger ver- Bpod Urani rs -9 (OEE 


sus older employees based upon the number of sign-ups they Younger 100 78 T2 484 48.4 

receive in the first week since the program was announced, with Older 100 122 22 484 48.4 

a cut-off set at 200. The results are shown in the bar chart below: 96.8 
120 


The HR managers want to be sure a difference exists before invest- 

100 ing resources into activities designed for younger or older employ- 
80 4 ees only. Therefore, the acceptable level of Type | error is set at 0.01. 

Rather than referring to a critical value table, the p-value associated 


oo ma m eunoe with a x’ value and the associated degrees of freedom can be found 
40 - | sw Older on any one of several statistical calculators found on the Internet. 
In this case, the researcher uses the calculator found at http://faculty. 
20 5 fre vassar.edu/lowry/tabs.html#csq. By simply plugging in the observed 
0 value of 96.8 and the number of degrees of freedom as indicated, 1 


Expected Observed in this case, the calculator returns a p-value. In this case, the p-value 
returned is less than 0.0001. Therefore, since the p-value is less than 
the acceptable level of risk, the researcher reaches the conclusion 
that the older workers are much more likely to attend the retirement 
seminar. They can design the seminar to meet the needs associated 
with the number and type of attendees. 


Alternatively, the calculation can be followed in tabular form: 


Location: 

Stand-Alone 60 50 10 100/50 = 2.0 
Shopping Center 40 50 —10 100/50 = 2.0 
Total 100 100 0 X= 4.0 


e Like many other probability distributions, the x’ distribution is not a single probability curve, 
but a family of curves. These curves vary slightly with the degrees of freedom. In this case, the 
degrees of freedom can be computed as 


df=k-1 
where 
k = number of cells associated with column or row data. 
Thus, the degrees of freedom equal 1 (df= 2 — 1 = 1). 
¢ Now the computed x’ value needs to be compared with the critical chi-square values associ- 
ated with the 0.05 probability level with 1 degree of freedom. In Table A.4 of the appendix the 
critical x” value is 3.84. Since the calculated x’ is larger than the tabular chi-square, the conclu- 


sion is that the observed values do not equal the expected values. Therefore, the hypothesis is 
supported. More Papa John’s restaurants are located in stand-alone locations. 


We discuss the chi-square test further in Chapter 20 as it is also frequently used to analyze con- 
tingency tables. 
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Hypothesis Test of a Proportion 


Researchers often test univariate statistical hypotheses about population proportions. The popula- 

tion proportion (7) can be estimated on the basis of an observed sample proportion (p). Conduct- 

ing a hypothesis test of a proportion is conceptually similar to hypothesis testing when the mean is hypothesis test of a 
the characteristic of interest. Mathematically the formulation of the standard error of the propor- proportion 


tion differs somewhat, though. A test that is conceptually similar 
to the one used when the mean 
is the characteristic of interest 
but that differs in the mathemati- 
cal formulation of the standard 
state is greater than 0.5. error of the proportion. 

The researcher formulates the hypothesis that the population proportion (7) exceeds 50 percent 


(0.5): 


Consider the following example. A state legislature is considering a proposed right-to-work 
law. One legislator has hypothesized that more than 50 percent of the state’s labor force is union- 
ized. In other words, the hypothesis to be tested is that the proportion of union workers in the 


Ay: = 7 > 0.5 


Suppose the researcher conducts a survey with a sample of 100 workers and calculates p = 0.6. 
Even though the population proportion is unknown, a large sample allows use of a Z-test (rather 
than the t-test). If the researcher decides that the decision rule will be set at the 0.01 level of sig- 
nificance, the critical Z-value of 2.57 is used for the hypothesis test. Using the following formula, 
we can calculate the observed value of Z given a certain sample proportion: 


pT 
‘obs S 
where 

p = sample proportion 

m = hypothesized population proportion 

Sp 


estimate of the standard error of the proportion 


4 [P1 aP — p) 
Sp = n OF Sp = z 


S, = estimate of the standard error of the proportion 


The formula for $, is 


= proportion of successes 


as) 
| 


q = 1 — p, = proportion of failures 


Yee 
100 


In our example, 


Z „ can now be calculated: 


obs SS, 
_ 0.6 = 0.5 
0.04899 
__ 04 
0.04899 
= 2.04 


The Z, value of 2.04 is less than the critical value of 2.57, so the hypothesis is not supported. 


A 
m 


The use of hypothesis testing is a critical skill that all business e Garbage in, garbage out always applies Š 
researchers should have experience with. Here are some tips of to hypothesis testing. If you don't care- 


the trade that may help you build on this skill. 
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Business researchers are often brought in to not just conduct 
survey research and analysis, but to help their stakeholders 
frame the research questions as well. Approach your research 
with the goal that hypotheses will be generated to support or 
reject business decisions. Therefore, carefully work with your 
sponsor in developing research questions that are, in fact, 


Hypothesis testing is often done using productivity or other 
performance benchmarks. Select your benchmarks care- 
fully. Make sure that you can justify their selection, and note 
any instance where a seemingly outlying benchmark is still 


fully select variables that are appropriate, 
the results you obtain will not be reflective 
of your research question. Also, as you have 
learned, outlying cases in your data can skew 
results. Note these cases carefully. 

e You have developed an appropriate research question, 
conducted your data collection, selected appropriate bench- 
marks, and conducted your hypothesis testing. What happens 
when your results are NOT supported? Be prepared for when 
this happens, because it will. You will need to have some way 
of offering alternative explanations, or find some valid reason 
to explain your results. 


Additional Applications of Hypothesis Testing 


The discussion of statistical inference in this chapter has been restricted to examining the difference 
between an observed sample mean and a population or pre-specified mean, a x” test examining the 
difference between an observed frequency and the expected frequency for a given distribution and 
Z-tests to test hypotheses about sample proportions when sample sizes are large. Other hypothesis 
tests for population parameters estimated from sample statistics exist but are not mentioned here. 
Many of these tests are no different conceptually in their methods of hypothesis testing. However, 
the formulas are mathematically different. The purpose of this chapter has been to discuss basic 
statistical concepts. Once you have learned the basic terminology in this chapter, you should have 
no problem generalizing to other statistical problems. 

The key to understanding statistics is learning the basics of the language. For this chapter, we 
begin to adopt a more practical perspective by focusing on the p-values to determine whether a 
hypothesis is supported rather than discussing null and alternative hypotheses. In more cases than 
not, low p-values (below the specified a) support researchers’ hypotheses.’ It is hoped that some of 
the myths about statistics have been shattered and that they are becoming easier to use. 


Summary 


1. Implement the hypothesis-testing procedure. Hypothesis testing can involve univariate, bivari- 
ate, or multivariate statistics. In this chapter, the focus is on univariate statistics. These are tests 
that involve one variable. Usually, this means that the observed value for one variable will be 
compared to some benchmark or standard. Statistical analysis is needed to test hypotheses when 
sample observations are used to draw an inference about some corresponding population. The 
research establishes an acceptable significance level, representing the chance of a Type I error, and 
then computes the statistic that applies to the situation. The exact statistic that must be computed 
depends largely on the level of scale measurement. 


2. Use p-values to test for statistical significance. A p-value is the probability value associated with a 
statistical test. The probability in a p-value is the probability that the expected value for some test dis- 
tribution is true. In other words, for a t-test, the expected value of the t-distribution is 0. If a researcher 
is testing whether or not a variable is significantly different from 0, then the p-value that results from 
the corresponding computed t-value represents the probability that the true population mean is actu- 
ally 0. For most research hypotheses, a low p-value supports the hypothesis. If a p-value is lower than 
the researcher’s acceptable significance level (œ), then the hypothesis is usually supported. 


3. Test a hypothesis about an observed mean compared to some standard. Researchers often have 
to compare an observed sample mean with some specified value. The appropriate statistical test to 
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compare an interval or ratio level variable’s mean with some value is either the Z- or t-test. The 
Z-test is most appropriate when the sample size is large or the population standard deviation is 
known. The t-test is most appropriate when the sample size is small or the population standard 
deviation is not known. In most practical applications the t-test and z-test will result in the same 
conclusion. The f-test is used more often in practice. 


4. Know the difference between Type I and Type Il errors. A Type I error occurs when a researcher 
reaches the conclusion that some difference or relationship exists within a population when in fact 
none exists. In the context of a univariate t-test, the researcher may conclude that some mean value for 
a variable is greater than 0 when in fact the true value for that variable in the population being consid- 
ered is 0. A Type II error is the opposite situation. When the researcher reaches the conclusion that no 
difference exists when one truly does exist in the population, the researcher has committed a Type II 
error. More attention is usually given to Type I errors. Type II errors are very sensitive to sample size. 


5. Know the univariate x? test and how to conduct one. A y’ test is one of the most basic tests for 
statistical significance. The test is particularly appropriate for testing hypotheses about frequen- 
cies arranged in a frequency or contingency table. The x’ test value is a function of the observed 
value for a given entry in a frequency table minus the statistical expected value for that cell. The 
observed statistical value can be compared to critical values to determine the p-value with any 
test. The x? test is often considered a goodness-of-fit test because it can test how well an observed 
matrix represents some theoretical standard. 


Key Terms and Concepts 


bivariate statistical analysis, 509 
chi-square (X°) test, 522 

critical values, 513 

degrees of freedom (df) , 519 
goodness-of-fit (GOF) , 522 
hypothesis test of a proportion, 525 


t-test, 518 
Type I error, 515 
Type II error, 515 


multivariate statistical analysis, 509 
nonparametric statistics, 517 
parametric statistics, 517 

p-value, 510 univariate statistical analysis, 509 
significance level, 510 


t-distribution, 518 


Questions for Review and Critical Thinking 


1. What is the purpose of a statistical hypothesis? 11. A researcher plans to ask employees whether they favor, oppose, 


2. What is a significance level? How does a researcher choose a sig- or are indifferent about a change in the company retirement 
nificance level? program. Formulate a hypothesis for a chi-square test and the 
3. What is the difference between a significance level and a p-value? way the variable would be created. 
4. How is a p-value used to test a hypothesis? 12. Give an example in which a Type I error may be more serious 
5. Distinguish between a Type I and Type II error. than a Type II error. 
6. What are the factors that determine the choice of the appropri- 13. Refer to the pizza store location x? data on pages 522-524. 
ate statistical technique? What statistical decisions could be made if the 0.01 significance 
7. A researcher is asked to determine whether or not a productiv- level were selected rather than the 0.05 level? 
ity objective (in dollars) of better than $75,000 per employee is 14. Determine a hypothesis that the following data may address and 
possible. A productivity test is done involving 20 employees. What perform a x? test on the survey data. 
conclusion would you reach? The sales results are as follows: a. American Idol should be broadcast before 9 p.m. 
a. 28,000 105,000 58,000 93,000 96,000 Agree 40 
b. 67,000 82,500 75,000 81,000 59,000 Neutral 35 
c. 101,000 60,500 77,000 72,500 48,000 Disagree 25 
d. 99,000 78,000 71,000 80,500 78,000 100 
8. Assume you have the following data: H : w # 200, S = 30, b., Political dffiliationis ofa group indicate 
n = 64, and X = 218. Conduct a two-tailed hypothesis test at Republicans 102 
the 0.05 significance level. Democrats 28 
9. Ifthe data in question 8 had been generated with a sample of 200 
25 (n = 25), what statistical test would be appropriate? 15. A researcher hypothesizes that 15 percent of the people in 
10. The answers to a researcher’s question will be nominally scaled. a test-market will recall seeing a particular advertisement. In 


What statistical test is appropriate for comparing the sample data 
with hypothesized population data? 


a sample of 1,200 people, 20 percent say they recall the ad. 
Perform a hypothesis test. 
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Research Activities 


1. ‘NET What is the ideal climate? Fill in the following blanks: 

The lowest temperature in January should be no lower than 

degrees. At least days should be sunny in January. 

a. Listat least 15 places where you would like to live. Using the 

Internet, find the average low temperature in January for each 
place. This information is available through various weather 
related Web sites such as http://www.weather.com or through 
each community’s local news Web site. Record the data in 

a spreadsheet or statistical package such as SPSS. Using the 
benchmark (preferred population low temperature) you filled 
in above, test whether the sample places that you would like 
to live have an ideal January minimum temperature. 

b. Using the same Web site, record how many days in January 
are typically sunny. Test whether or not the number of sunny 
days meets your standard. 

For each location, record whether or not there was measur- 


° 


able precipitation yesterday. Test the following hypothesis: 


H: Among places you would like to live, there is less than a 
33.3 percent chance of rain/snow on a given day (five days 


out of fifteen). 


Part 6: Data Analysis and Presentation 


2. ETHICS Examine the statistical choices under “analyze” in SPSS. 


Click on compare means. To compare an observed mean to 
some benchmark or hypothesized population mean, the avail- 
able choice is a one-sample t-test. A researcher is preparing a 
report and finds the following result testing a hypothesis that 
suggested the sample mean did not equal 14: 

a. What is the p-value? Is the hypothesis supported? 

b. Write the 95% confidence interval which corresponds to an 
a of 0.05. 

c. Technically, since the sample size is greater than 30,a Z-test 
might be more appropriate. However, since the t-test result is 
readily available with SPSS, the research presents this result. 
Is there an ethical problem in using the one-sample t-test? 


One-Sample Statistics 


Std. Std. Error 
N Mean Deviation Mean 
1997-2000 67 14.5337 16.02663 1.95796 


Test Value = 14 


t df 


Sig. (two-tailed) 


95% Confidence Interval 
of the Difference 


Mean Difference Lower Upper 


1997-2000 0.273 66 


0.786 0.53373 —3.3755 4.4429 


Case 21.1 Quality Motors 


Quality Motors is an automobile dealership that 
regularly advertises in its local market area. It 
claims that a certain make and model of car aver- 
ages 30 miles to a gallon of gas and mentions that 
this figure may vary with driving conditions. A 
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local consumer group wishes to verify the adver- 
tising claim. To do so, it selects a sample of recent purchasers of this 
make and model of automobile. It asks them to drive their cars until 
two tanks of gasoline have been used up and to record the mileage. 
The group then calculates and records the miles per gallon for each 
year. The data in Case Exhibit 21.1—1 portray the results of the tests. 


Questions 

1. Formulate a statistical hypothesis appropriate for the consumer 
group’s purpose. 

Calculate the mean average miles per gallon. Compute the 


iS) 


sample variance and sample standard deviation. 
3. Construct the appropriate statistical test for your hypothesis, 
using a 0.05 significance level. 


Miles per Gallon Information 


Miles Miles 
Purchaser per Gallon Purchaser per Gallon 
1 30.9 13 27.0 
2 24.5 14 26.7 
3 312 15 31.0 
4 28.7 16 23.5 
5 354 17 29.4 
6 29.0 18 26.3 
7 28.8 19 275 
8 23.1 20 28.2 
g 31.0 21 28.4 
10 30.2 22 29% 
11 28.4 23 21.9 
12 29.3 24 30.9 


CHAPTER 22 
BIVARIATE 
STATISTICAL 
ANALYSIS: 

oe een ctu cameramen DIFFERENCES 
pire ee yee sore BETWEEN TWO 


. Calculate and interpret an independent samples t-test 


Se SNE Mea VARIABLES 


Understand the concept of analysis of variance (ANOVA) 
5. Interpret an ANOVA table 


Chapter Vignette: Gender Differences and Double 
Standards in Ethical Perceptions 


What if you went to trade in your car, knowing that it had an oil leak “which is not very notice- 
able and doesn’t require immediate attention,” but would require $200 to have fixed in the near 
future?' Would you feel a moral obligation to tell the car dealer? How about if you went to buy a 
car with the same issue? Would it be ethical for the dealer to sell you the car without mentioning 
the oil leak? 

Ethical conduct, both of businesses and consumers, is an important issue in the business 
world. Recent research conducted in Flanders, a European region that includes parts of Belgium, 
France, and the Netherlands, investigated two aspects of ethical perceptions with relevance 
to business.’ First, is there a difference between women and men in their ethical perceptions? 
Second, is there an ethical double standard—that consumers view an action performed by a cus- 
tomer as more ethical than the same action performed by a business? The researchers hypoth- 
esized that women would report higher ethical standards than men and that the “double 
standard” would exist with respondents perceiving customer 

actions as more ethical than business behavior. 

While we would need to talk to every man and woman 

to actually know if their ethical perceptions were different, as 
researchers we understand that a sample of the population has 
to be used in most situations. In this case, business researchers 
asked 127 respondents to evaluate a series of ethical scenarios 
(short stories with ethical implications) including the car with the 
oil leak mentioned above (Scenario 2). These scenarios were split 
so that half of them had a consumer engaging in the act while 
the other half had a business performing the act. The respondents 
were presented the scenarios and then asked to indicate how eth- 


ical they thought the act described was on a scale from 1 indicat- 
ing “totally unethical” 


ev/SHUTTERSTOCS 
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to 7 indicating “totally ethical.” Across the four scenarios, the results show: 


Gender Scenario 1 Scenario 2 Scenario 3 Scenario 4 
Male 5.59 4.38 5.83 6.24 
Female 52i B12 4.88 Sl 


While all four scenarios indicate that men rated the activity as more ethical than women, to 
generalize these results from the sample to the population we need to perform statistical tests. 


These tests show that there is not a significant difference in three of the four scenarios, with only 
Scenario 2 showing a statistically significant difference at the 0.05 level. 
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test of differences 


An investigation of a hypothesis 
stating that two (or more) groups 
differ with respect to measures 
on a variable. 


—Yogi Berra 


Part 6: Data Analysis and Presentation 


When testing for the presence of the proposed double standard, the results show: 


Source Scenario 1 Scenario 2 Scenario 3 Scenario 4 
Consumer 5.38 3.70 532 5.95 
Corporate 3.36 1.67 3.38 4.97 


In this case, there is a statistically significance difference on all four scenarios. In other words, people 
perceive the same act as less ethical when performed by a business than a consumer. 

How do we do these statistical tests? How can we determine if the results we see might be unique 
to the sample, or if these results are likely to be found across the population? This chapter focuses on 
this question when we are examining differences between two variables. 


Introduction 


The Chapter Vignette is just one illustration of business researchers’ desire to test hypotheses stating that 
two groups differ. In business research, differences in behavior, characteristics, beliefs, opinions, emo- 
tions, or attitudes are commonly examined. For example, in the most basic experimental design, the 
researcher tests differences between subjects assigned to an experimental group and subjects assigned to 
the control group. The experiment illustration presented in Chapter 12 on self-efficacy is an example 
of this approach. A survey researcher may be interested in whether male and female consumers pur- 
chase a product in the same amount. Business researchers may also test whether or not business units in 
Europe are as profitable as business units in the United States. Such tests are bivariate tests of differences 
when they involve only two variables: a variable that acts like a dependent variable and a variable that 
acts as a classification variable. These bivariate tests of differences are the focus of this chapter. 


What Is the Appropriate Test of Difference? 


Exhibit 22.1 illustrates that the type of measurement, the nature of the comparison, and the num- 
ber of groups to be compared influence the statistical choice. Often researchers are interested in 
testing differences in mean scores between groups or in comparing how two groups’ scores are 
distributed across possible response categories. We will focus our attention on these issues.’ The 
rest of the chapter focuses on how to choose the right statistic for two-group comparisons and per- 
form the corresponding test. Exhibit 22.1 provides a frame of reference for the rest of the chapter 
by illustrating various possible comparisons involving a few golfers. 

Construction of contingency tables for x? analysis gives a procedure for comparing observed 
frequencies of one group with the frequencies of another group. This is a good starting point from 
which to discuss testing of differences. 


Cross-Tabulation Tables: The yx? Test 
for Goodness-of-Fit 


Cross-tabulation is one of the most widely used statistical techniques among business researchers. 
Cross-tabulations are intuitive, easily understood, and lend themselves well to graphical analysis 
using tools like bar charts. Cross-tabs are appropriate when the variables of interest are less-than 
interval in nature. 

As we discussed in Chapter 20, a cross-tabulation, or contingency table, is a joint frequency 
distribution of observations on two or more variables. Researchers generally rely on two-variable 
cross-tabulations the most since the results can be easily communicated. Cross-tabulations are much 
like tallying. When two variables exist, each with two categories, four cells result. The x? distribution 
provides a means for testing the statistical significance ofa contingency table. In other words, the bivariate 
X test examines the statistical significance of relationships between two less-than interval variables. 
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1. Is there a relationship between student gender and their 
major? Does one gender select into certain majors more than 
another? Use cross-tabulations and the x? test to examine the 
relationship between gender and major. What did you find? 
Is there a difference between those respondents that are cur- 
rently employed and those that are not currently employed 


` = Our survey includes data that can be 
y g appropriately analyzed with the tech- 
i niques discussed in this chapter. After 
reading the chapter, access the online 
data and answer the following three 
questions: 


regarding their goal achievement and life satisfac- 
tion? Respondents indicated whether or not they 
were currently employed. Use a t-test to examine the 
differences between the employed/not employed 
respondents on the six questions which ask: 


a. lam energetically pursuing my goals. 


b. | really can’t see any way around my problems. 


EXHIBIT 22.1 Some Bivariate Hypotheses 


Information Dolly 

Average Driver 135 

Distance 

(meters) 

oO 30 

Average 7- 140 

Wood Distance 

(meters) 

oO 30 

Sample size 28 

(number of drives 

balls hit) 28 
7-woods 

Number of 4 

Drives in 

Fairway 

Drives missing 16 

right of fairway 

Drives missing 8 


left of fairway 


Golfer 


Lori 


150 


25 


145 


30 
30 drives 


28 
7- woods 


22 


185 


30 


150 


30 


29 drives 


Hypothesis 
or Research 
Question 


Lori hits her 
drives further 
than Dolly 


Mel hits her 
driver further 
than her 
7-wood 


A relationship 
exists between 
golfers and 
7-wood distance 


Mel drives 

the ball more 
accurately than 
Dolly 


A relationship 
exist between 
golfers and 
accuracy 


apap 


What did you find? 


lam meeting the goals | set for myself. 
I am simply not being very successful these days. 
| know there are many ways to achieve my goals. 
My life could hardly be any better 


3. Is there a difference among the various student classifications 
and their attitude regarding their goal achievement and life 
satisfaction (the questions identified in part 2 above)? One 
question asks the respondents to indicate their level as a 
student (lower-level undergrad, upper-level undergrad, etc.). 
Use ANOVA to examine any differences in attitudes across 


the student classification groups. What did you find? 


Level of 
Measurement 
Involved 


Golfer = Nominal; 
Drive Distance = 
Ratio 


Club = Nominal 
(7-wood or driver); 
7-Wood Distance 
= Ratio 


Golfer = Nominal; 
Distance = Ratio 


Golfer = Nominal; 
Accuracy = 
Nominal (Right, 
Fairway, Left) 


Golfer = Nominal; 
Accuracy = 
Nominal (Right, 
Fairway, Left) 


Statistic Used 


Independent 
Samples t-test to 
compare mean 
distance 


Paired-Samples 
t-test to compare 
mean distances for 
Mel 


One-Way ANOVA to 
compare means for 
the three groups 


Cross-Tabulation 


with xX? Statistic 


Cross-Tabulation 
with X? Statistic 


Comment 


The data for Lori and Dolly 
are used. 


Only the data for Mel are 
used (std of diff = 30) 


All data for 7-wood 
distance are used 
(MSE = 30) 


Resulting cross tabulation 
table is 2 rows X 3 
columns (rows = golfer 
and columns = accuracy 
(fairway, right left) 


Cross-tabulation is now 
3 rows X 3 columns 


COURTESY OF QUALTRICS.COM 


Supported 
(t= 2.07, df = 
56, p < .05) 


Supported 
(¢= 6.39, 
df = 29) 
p <.05) 


Not 
supported 
(F = 0.83, ns) 


Supported 
Oe = OS, 
df = 3, 
p <.05) 


Supported 
(x? = 23.7, 
df = 4, 
p <.05) 
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Part 6: Data Analysis and Presentation 


The x? test for a contingency table involves comparing the observed frequencies (O,) with 
the expected frequencies (E;) in each cell of the table. The goodness- (or closeness-) of-fit of the 
observed distribution with the expected distribution is captured by this statistic. Remember that 
the convention is that the row variable is considered the independent variable and the column 
variable is considered the dependent variable. 

Recall that in Chapter 21 we used a x? test to examine whether or not Papa John’s restaurants 
in California were more likely to be located in a stand-alone location or in a shopping center. The 
univariate (one-dimensional) analysis suggests that the majority of the locations (60 percent) are 
stand-alone units: 


Location One-Way Frequency Table 


Stand-Alone 60 stores 
Shopping Center 40 stores 
Total 100 stores 


Recall that the x? = 4.0 with 1 degree of freedom (p < 0.01). 
Is there any effect of location of Papa John’s restaurants? Suppose the researcher wishes to 
examine the following hypothesis: 


Stand-alone locations are more likely to be profitable than are shopping center locations. 


While the researcher is unable to obtain the dollar figures for profitability of each unit, a press 
release indicates which Papa John’s units were profitable and which were not. Cross-tabulation 
using a X’ test is appropriate because 


e The independent variable (location) is less-than interval. 
e The dependent variable (profitable/not profitable) is less-than interval. 


The data can be recorded in the following 2 X 2 contingency table: 


Location Profitable Not Profitable Total 
Stand-Alone 50 10 60 
Shopping Center 15 25 40 
Totals 65 35 100 


Several conclusions appear evident. One, it seems that more stores are profitable than not profitable 
(65 versus 35, respectively). Secondly, more of the profitable restaurants seem to be in stand-alone loca- 
tions (50 of the 65). However, is the difference strong enough to be statistically significant? 

Is the observed difference between stand-alone and shopping center locations the result of 
chance variation due to random sampling? Is the discrepancy more than sampling variation? The 
X’ test allows us to conduct tests for significance in the analysis of the R X C contingency table 
(where R = row and C = column). The formula for the x? statistic is the same as that for one-way 
frequency tables (see Chapter 21): 


, yr By 
x=> z 


X? = chi-square statistic 


9 
| 


= observed frequency in the ith cell 
E, = expected frequency in the ith cell 


Again, as in the univariate x’ test, a frequency count of data that nominally identify or categorically 
rank groups is acceptable. 

If the researcher’s hypothesis is true, the frequencies shown in the contingency table should 
not resemble a random distribution. In other words, if location has no effect on profitability, the 
profitable and unprofitable stores would be spread evenly across the two location categories. This 
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is really the logic of the test in that it compares the observed frequencies with the theoretical 
expected values for each cell. 

After obtaining the observations for each cell, the expected values for each cell must be obtained. 
The expected values are what we would find if there is no relationship between the two variables. 
In this case, that the location of the pizza store has no relationship with whether or not the store is 
profitable. The expected values for each cell can be computed easily using this formula: 

RG 


n 


ij 


R; = total observed frequency count in the ith row 


AG) 
II 


total observed frequency count in the jth column 
n = sample size 


Only the total column and total row values are needed for this calculation. Thus, the calcula- 
tion could be performed before the data are even tabulated. The following values represent the 
expected values for each cell: 


Location Profitable Not Profitable Total 
Stand-Alone (60 Xx 65)/100 = 39 (60 X 35)/100 = 21 60 
Shopping Center (65 x 40)/100 = 26 (40 x 35)/100 = 14 40 
Totals 65 35 100 


Notice that the row and column totals are the same for both the observed and expected contingency 
matrices. These values also become useful in providing the substantive interpretation of the relation- 
ship. Significant variation from the expected value indicates a relationship and tells us the direction. 

The actual bivariate x? test value can be calculated in the same manner as for the univariate 
test. The one difference is that the degrees of freedom are now obtained by multiplying the num- 
ber of rows minus one (R — 1) times the number of columns minus one (C — 1): 


(O;- By’ 
2 = 
e=- 50- 
with (R — 1)(C — 1) degrees of freedom. The observed and expected values can be plugged into 
the formula as follows: 


2 2 


(50-39) (10 = 21)" , 15 = 26)" | (25-14) 


x = 39 21 26 14 
= 3.102 + 5.762 + 4.654 + 8.643 
= 22.16 


The number of degrees of freedom equals 1: 
R= 1)(C-1)N)=e2@-VYe-Y)=1 


From Table A.4 in the appendix, we see that the critical value at the 0.05 probability level 
with 1 df is 3.84. Thus, we are very confident that the observed values are not equal to the 


expected values. Before the hypothesis can be supported, however, the researcher must check and 
see that the deviations from the expected values are in the hypothesized direction. Since the differ- 
ence between the stand-alone locations’ observed profitability and the expected values for that cell 
are positive, the hypothesis is supported. Location is associated with profitability. The Research 
Snapshot on the next page provides another example of cross-tabs and a x? test. 

Thus, testing the hypothesis involves two key steps: 


1. Examine the statistical significance of the observed contingency table. 
2. Examine whether the differences between the observed and expected values are consistent 
with the hypothesized prediction. 


The examples provided both have 2-by-2 contingency tables (that is, two levels of two vari- 
ables). However, cross-tabulations and the x? test can be used regardless of the number of levels. 
For instance, if the Papa John’s locations were instead stand-alone, shopping center, and delivery 
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Chi-Training 


When is a cross-tabulation with a x? test appropriate? The answer that the new technology is associated with 
to this question can be determined by answering these questions: more incidences of accurate rather than 


e Are multiple variables expected to be related to one another? 


e Is the independent variable nominal or ordinal? Technology and Accuracy 
e Is the dependent variable nominal or ordinal? 60 1 
When the answer to all of these questions is yes, cross- 
tabulation with a x? test will address the research question. One 50 
common application involves the effect of some workplace 
change. For instance, this might involve the adoption of a new 40 
technology or the effect of training. For instance, consider the fol- 
lowing contingency data represented in bar charts to the right. 
The data show whether 30>] Œ Old Technology 


has been. In this case, the bar chart indicates 


inaccurate information. 


or not the adoption of a new 
information system produced 20 
accurate or inaccurate infor- 


mation. The 2-by-2 contin- 10 

gency table underlying this 

bar chart produces a x? value 0 

of 5.97 with 1 degree of free- Accurate Inaccurate 


dom. The p-value is less than : = ne ene Pate a 
à ources: For examples of research involving this type of analysis, see Gohmann, 
0.05; thus, the new technology S. E., R. M. Barker, D. J. Faulds, and J. Guan, “Salesforce Automation, Perceived 
does seem to have changed Information Accuracy and User Satisfaction,” Journal of Business and Industrial 
accuracy. However, we must Marketing 20 (2005), 23-32; Makela, C. J. and S. Peters, “Consumer Education: 
i Creating Consumer Awareness among Adolescents in Botswana,” International 
examine the actual cell counts Journal of Consumer Studies 28 (September 2004), 379-387. 


to see exactly what this effect 


independent samples t-test 


A test for hypotheses stating 
that the mean scores for some 
interval- or ratio-scaled vari- 
able grouped based on some 
less-than interval classificatory 
variable. 
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only, we would have a 3-by-2 contingency table. Or, perhaps we want to look at the distribu- 
tion of our male and female sales reps across our five product lines, which would give us a 2-by-5 
contingency table. The number of cells is not limited. However, proper use of the x’ test requires 
that each expected cell frequency (E) have a value of at least 5. If this sample size requirement is 
not met, the researcher should take a larger sample or combine (collapse) response categories. 


The t-Test for Comparing Two Means 


Cross-tabulations and the x? test are appropriate when both variables are less-than interval level. 
However, researchers often want to compare one interval or ratio level variable across categories 
of respondents. The Chapter Vignette describes such a situation. The researchers are interested in 
comparing the ethical perceptions between genders. When a researcher needs to compare means for 
a variable grouped into two categories based on some less-than interval variable, a t-test is appropri- 
ate. One way to think about this is testing the way a dichotomous (two-level) independent variable 
is associated with changes in a continuous dependent variable. Several variations of the t-test exist. 


Independent Samples t-Test 


Most typically, the researcher will apply the independent samples t-test, which tests the differences 
between means taken from two independent samples or groups. So, for example, if we measure 
the price for some designer jeans at 30 different retail stores, of which 15 are Internet-only stores 
(pure clicks) and 15 are traditional stores, we can test whether or not the prices are different based 
on store type with an independent samples t-test. The t-test for difference of means assumes the 
two samples (one Internet and one traditional store) are drawn from normal distributions and that 
the variances of the two populations are approximately equal (homoscedasticity). 
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Chapter 22: Bivariate Statistical Analysis: Differences Between Two Variables 


INDEPENDENT SAMPLES t-TEST CALCULATION 


The t-test actually tests whether or not the differences between two means is zero. Not surpris- 
ingly, this idea can be expressed as the difference between two population means: 


4, = u, which is equivalent to, u, — u, = 0 
However, since this is inferential statistics, we test the idea by comparing two sample means 
X-X). 
A verbal expression of the formula for t is 


Sample Mean 1 — Sample Mean 2 
Variability of random means 


In almost all situations, we will see from the calculation of the two sample means that they are 
not exactly equal. The question is actually whether the observed differences have occurred by 
chance, or likely exist in the population. The t-value is a ratio with information about the dif- 
ference between means (provided by the sample) in the numerator and the standard error in the 
denominator. To calculate t, we use the following formula: 
t= XX, 

XiX 
where 


= mean for group 1 
X, = mean for group 2 
Sz, -57 pooled, or combined, standard error of difference between means 
A pooled estimate of the standard error is a better estimate of the standard error than one based 
on the variance from either sample. The pooled standard error of the difference between means 
of independent samples can be calculated using the following formula: 


(n, = 1)S; + (n, — 1)S;) 1 $ 1 


Sz z = | | 
%7% n, tn 2 no ft, 
where 
S| = variance of group 1 
2 . 
S} = variance of group 2 


n, = sample size of group 1 
n, = sample size of group 2 


Are business majors or sociology majors more positive about a career in business? A t-test can be 
used to test the difference between sociology majors and business majors on scores on a scale mea- 
suring attitudes toward business careers. We will assume that the attitude scale is an interval scale. 
The result of the simple random sample of these two groups of college students is shown below: 


Business Students Sociology Students 


X = 165 X, = 122 
$= 211 Si = 26 
i, = A] li, = At 


A high score indicates a favorable attitude toward business. We can see in the sample that business 
students report a higher score (16.5) than sociology students (12.2). This particular f-test tests whether 
the difference in attitudes between sociology and business students is significant. That is, is the sample 
result due to chance or do we expect this difference to exist in the population? A higher t-value is 
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pooled estimate of the 
standard error 


An estimate of the standard error 
for a t-test of independent means 
that assumes the variances of 
both groups are equal. 
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associated with a lower p-value. As the t gets higher and the p-value gets lower, the researcher has 
more confidence that the means are truly different. The relevant data computation is 


2 2 | 
Oe = (n, = 1)S; + (n, a 1)S; f + *| 
X-X n, + n = 2 n n, 


_ yee + Caeo | 1 4 ) 
33 


= 0.797 


The calculation of the t-statistic is 
= Xx, — X, 
© SAX 
oe 16.5 — 12.2 
g 0.797 
— 43 
~ 0.797 


= 5.395 
In a test of two means, degrees of freedom are calculated as follows: 
df=n—k 
where 
n=n, Tn, 
k = number of groups 


In our example df equals 33((21 + 14) — 2). Ifthe 0.01 level of significance is selected, reference to 
Table A.3 in the appendix yields the critical t-value. The t-value of 2.75 must be surpassed by the 
observed t-value if the hypothesis test is to be statistically significant at the 0.01 level. The calcu- 
lated value of t, 5.39, far exceeds the critical value of t for statistical significance, so it is significant at 
a = 0.01. The p-value is less than 0.01. In other words, this research shows that business students have 
significantly more positive attitudes toward business than do sociology students. The Research Snap- 
shot on the next page describes the situation when an independent samples t-test should be used. 


PRACTICALLY SPEAKING 


While it is good to understand the process involved, in practice computer software is used to 
compute the t-test results. Exhibit 22.2 displays a typical t-test printout. These particular results 
examine the following research question: 


RQ: Does religion relate to price sensitivity? 


This question was addressed in the context of restaurant and wine consumption by allowing 100 con- 
sumers to sample a specific wine and then tell the researcher how much they would be willing to pay 
for a bottle of the wine. The sample included 57 Catholics and 43 Protestants. Because no direction of 
the relationship is stated (no hypotheses is offered), a two-tailed test is appropriate. Although instructors 
still find some value in having students learn to perform the t-test calculations, this procedure is usually 
computer generated and interpreted today. Using SPSS, the click-through sequence would be: 


Analyze > Compare Means > Independent-Samples t-test 


Then, the variable used to categorize the respondent as either Catholic or Protestant would be 
entered as the grouping variable and the variable with the amount the respondent was willing to pay 
as the test variable. 

The interpretation of the t-test is made simple by focusing on either the p-value or the confi- 
dence interval and the group means. Here are the basic steps: 


1. Examine the difference in means to find the “direction” of any difference. In this case, 
Catholics are willing to pay nearly $11 more than Protestants. 


| h ba Expert “T-eeze” The one-tailed p-value is 0.0045; thus the conclusion is reached that 
= When is an independent samples t-test experts do take less time to make a decision than do novices. 


appropriate? Once again, we can find 


j r . Decision Time (seconds) 
out by answering some simple questions: 


140 
G Is the dependent variable interval or ratio? 


e Can the dependent variable scores be grouped based upon 120 
some categorical variable? 
e Does the grouping result in scores drawn from independent 100 
samples? 
e Are two groups involved in the research question? 80 E Series 1 


When the answer to all questions is yes, an independent samples 60 
t-test is appropriate. Often, business researchers may wish to 


examine how some process varies between novices and experts 40 

(or new employees and current employees). Consider the 

following example. 20 
Researchers looked at the difference in decision speed for 

expert and novice salespeople faced with the same situation. 0 


5 
Decision speed is a ratio dependent variable and the scores are Kovos Bpan 


grouped based on whether or not the salesperson is an expert 
: : : : Source: Shepherd, D. G., S. F. Gardial, 
or a novice. Thus, this categorical variable produces two groups. WAG. Johnson, and O ‘Cognitive 
The results across 40 respondents, 20 experts, and 20 novices, are Insights into the Highly Skilled or Expert 
shown at the top right. Salesperson,” Psychology & Marketing 
A f ee A f A 23 (February 2006), 115-138. Reprinted 
The average difference in decision time is 38 seconds. Is this ae R 


with permission of John Wiley & Sons, 
significantly different from 0? The calculated t-test is 2.76 with 38 df. Inc. 
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© IMAGE SOURCE/JUPITER IMAGES 


Independent Samples t-Test Results 


Group Statistics 


Std. Std. Error 1. Shows mean, standard deviation, and 
Mean avers Mean standard error for each group 


price Catholic 57 61.00 43.381 5.746 (eatholicond Frotestan)) 
Protestant 43 50.27 64.047 9.767 


Independent Samples Test 


NOTE: Top row 


shows results Levene's Test for 
assuming equal Equality of Variances t-Test for Equality of Means 
variances. Bottom 


row assumes 95% Confidence 
variance is different Interval of the 


in each. Difference 


Sig. Mean Std. Error 
(2-tailed) | Difference Difference 


Equal 
variances 769 383 
assumed 


Equal 
variances 
not 
assumed 


2. Computed t-test value 3. P-value for t-value and 4. Confidence intervals for 
shown in this column associated degrees of a = 0.05 (100% — 95%). 
(t = 0.998). freedom (t = 0.998, 98 d.f.) In this case, it includes 0. 
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2. Compute or locate the computed t-test value. In this case, t = 0.998. 

3. Find the p-value associated with this t and the corresponding degrees of freedom. Here, the p-value 
(two-tailed significance level) is 0.321. This suggests a 32 percent chance that the means are actually 
equal given the observed sample means. In other words, the difference we see may be due to this 
sample of 100 respondents rather than being found in the population. Assuming a 0.05 acceptable 
Type I error rate (a), the appropriate conclusion is that the means are not significantly different. 

4. The difference can also be examined using the 95 percent confidence interval (—10.603 < 
X, = X, < 32.070). Since the confidence interval includes 0, we lack sufficient confidence 
that the true difference between the population means is not 0. 


A few points are worth noting about this particular result. First, strictly speaking, the t-test assumes 
that the two population variances are equal. A slightly more complicated formula exists which will 
compute the t-statistic assuming the variances are not equal.* SPSS provides both results when an 
independent samples t-test is performed. The sample variances appear considerably different in this 
case (43.4, 64.0). Nonetheless, the conclusions are the same using either assumption. In business 
research, we often deal with values that have variances close enough to assume equal variance. This 
isn’t always the case in the physical sciences where variables may take on values of drastically different 
magnitude. Thus, the rule of thumb in business research is to use the equal variance assumption. In 
the vast majority of cases, the same conclusion will be drawn using either assumption. 

Second, notice that even though the means appear to be not so close to each other, the statistical 
conclusion is that they are the same. The substantive conclusion is that Catholics and Protestants would 
not be expected to pay different prices. Why is it that means do not appear to be similar, yet that is the 
conclusion? The answer lies in the variance. Respondents tended to provide very wide ranges of accept- 
able prices. Notice how large the standard deviations are compared to the mean for each group. Since the 
t-statistic is a function of the standard error, which is a function of the standard deviation, a lot of variance 
means a smaller t-value for any given observed difference. When this occurs, the researcher may wish to 
double check for outliers. A small number of wild price estimates could be inflating the variance for one 
or both groups. An additional consideration would be to increase the sample size and test again. 

Third, a t-test is used even though the sample size is greater than 30. Strictly speaking, a Z-test 
could be used to test this difference. Researchers often employ a t-test even with large samples. As 
samples get larger, the t-test and Z-test will tend to yield the same result. Although a t-test can be 
used with large samples, a Z-test should not be used with small samples. Also, a Z-test can be used 
in instances where the population variance is known ahead of time. 

As another example, consider 11 sales representatives categorized as either young (1) or old (2) 
on the basis of their ages in years, as shown in Exhibit 22.3. The exhibit presents a SAS (pronounced 
“sass”) computer output that compares the mean sales volume for these two groups. We can see that 
the mean for the young group is 61,879 and that of the old group is 86,962, which appears considerably 
different. Again, though, this difference is not statistically significant at the 0.05 level as the p-value is 
0.3218. In this case, the very small sample size (11 in total) drastically limits the statistical power. 


> SAS t-Test Output 


est Procedure Variable: CR Sales 


Standard Standard 


Mean Deviation Error Minimum Maximum Variances d.f. Prob > |T| 
1 6 61879.33333 22356.20845 9126.88388 41152.00000 103059.0000 Unequal —0.9758 5.2 0.3729 
2 5) 86961.80000 53734.45098 24030.77702 42775.00000 172530.0000 Equal — 1.0484 9.0 0.3218 


For H; Variances are equal, F = 5.78 with 4 and 5 d.f., Prob. > F = 0.0815. 


Paired-Samples t-Test 


What happens when means need to be compared that are not from independent samples? Such 
might be the case when the same respondent is measured twice—for instance, when the respondent 
is asked to rate both how much he or she likes shopping on the Internet and how much he or she 
likes shopping in traditional stores. Since the liking scores are both provided by the same person, 
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the assumption that they are independent is not realistic. Additionally, if one compares the prices the 
same retailers charge in their stores with the prices they charge on their Web sites, the samples cannot 
be considered independent because each pair of observations is from the same sampling unit. 

A paired-samples t-test is appropriate in this situation. The idea behind the paired-samples 
t-test can be seen in the following computation: 


d 
s/n 


t= 


where d is the difference between means, s 18 the standard deviation of the observed differences, 
and n is the number of observations. Researchers also can compute the paired-samples t-test using 
statistical software. For example, using SPSS, the click-through sequence would be: 


Analyze > Compare Means > Paired-Samples t-test 


A dialog box then appears in which the “paired variables” should be entered. When a paired-samples 
t-test is appropriate, the two numbers being compared are usually scored as separate variables. 

Exhibit 22.4 displays a paired-samples t-test result. A sample of 143 young adult consumers was 
asked to rate how likely they would be to consider purchasing an engagement ring (or want their 
ring purchased) via (a) an Internet retailer and (b) a well-known jewelry store. Each respondent 
provided two responses, much as in a within-subjects experimental design. The bar chart depicts 
the means for each variable (Internet purchase likelihood and store purchase likelihood). The t-test 
results suggest that the average difference of —42.4 is associated with a t-value of -16.0. As can be 
seen using either the p-value (0.000 rounded to 3 decimals) or the confidence interval —47.6 < d < 
37.1), which does not include 0, the difference is significantly different from 0. Therefore, the results 
suggest a higher likelihood to buy a wedding ring in a well-known bricks-and-mortar retail store 
than via an Internet merchant. For those of you considering marriage, this might be a good tip! 


EXHIBIT 22.4 Example Results for a Paired-Samples t-Test 


Shopping Intentions 


Internet Store 
Paired-Samples Test 


Paired Differences 


95% Confidence Interval 
of the Difference 


Std. Std. Error 
Deviation Mean 
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paired-samples t-test 


An appropriate test for compar- 
ing the scores of two interval 
variables drawn from related 
populations. 


Sig. 
(2-tailed) 


Pair 1 intl — int2 — 42.388 31.660 2.648 —47.622 —37.154 = 16:0 142 0.000 
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Z-test for differences of 
proportions 


A technique used to test the 
hypothesis that proportions are 
significantly different for two 
independent samples or groups. 
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Management researchers have used paired-samples f-tests to examine the effect of downsizing 
on employee morale. For instance, job satisfaction for a sample of employees can be measured 
immediately after the downsizing. Some months later, employee satisfaction can be measured 
again. The difference between the satisfaction scores can be compared using a paired-samples 
t-test. Results suggest that the employee satisfaction scores increase within a few months of the 
downsizing as evidenced by statistically significant paired-samples t-values.* 


The Z-Test for Comparing Two Proportions 


What type of statistical comparison can be made when the observed statistics are proportions? 
Suppose a researcher wishes to test the hypothesis that wholesalers in the northern and southern 
United States differ in the proportion of sales they make to discount retailers. Testing whether 
the population proportion for group 1 (p,) equals the population proportion for group 2 (p,) is 
conceptually the same as the f-test of two means. This section illustrates a Z-test for differences of 
proportions, which requires a sample size greater than 30. 

The test is appropriate for a hypothesis of this form: 


Hy T = T, 
which may be restated as 
Hy: 7, — 17, = 0 
Comparison of the observed sample proportions p, and p, allows the researcher to ask whether the 


difference between two large (greater than 30) random samples occurred due to chance alone. The 
Z-test statistic can be computed using the following formula: 


(Pi Z P) — (T, = T) 


Z= 
Py —Po 
where 


p, = sample proportion of successes in group 1 
p, = sample proportion of successes in group 2 
Tm, — T, = hypothesized population proportion 1 minus hypothesized population proportion 2 


„p = Pooled estimate of the standard error of differences in proportions 
r 
The statistic normally works on the assumption that the value of 7, — 77, is zero, so this formula 
is actually much simpler than it looks at first inspection. Readers also may notice the similarity 
between this and the paired-samples t-test. 


To calculate the standard error of the differences in proportions, use the formula 


where 
p = pooled estimate of proportion of successes in a sample 


1 — p, or pooled estimate of proportion of failures in a sample 


a! 
II 


= 
II 


sample size for group 1 
n, = sample size for group 2 


To calculate the pooled estimator, p, use the formula 


Suppose the survey data are as follows: 


Northern Wholesalers Southern Wholesalers 


p, = 0.35 p, = 0.40 


n, = 100 n, = 100 
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First, the standard error of the difference in proportions is 


fia dk ok 
tere = [pa n y F 


= / (0.375) (0.625) l + 165) = 0.068 


where 


(100)(0.35) + (100)(0.40) 
pe 100 + 100 


= 0.375 


If we wish to test the two-tailed question of no difference, we must calculate an observed Z-value. 
Thus, 
(P, — P.) (T, — T) 


P1—P> 
(0.35 — 0.40) — (0) 
0.068 


= =0.73 


In this example the idea that the proportion of sales differs by region is not supported. The calcu- 
lated Z-value is less than the critical Z-value of 1.96. Therefore, the p-value associated with the 
test is greater than 0.05. 


Analysis of Variance (ANOVA) 


What Is ANOVA? 


So far, we have discussed tests for differences between two groups. However, what happens 


when we have more than two groups? For example, what if we want to test and see if employee 
turnover differs across our five production plants? When the means of more than two groups or 
populations are to be compared, one-way analysis of variance (ANOVA) is the appropriate statisti- 
cal tool. ANOVA involving only one grouping variable is often referred to as one-way ANOVA 
because only one independent variable is involved. Another way to define ANOVA is as the 
appropriate statistical technique to examine the effect of a less-than interval independent variable 
on an at-least interval dependent variable. Thus, a categorical independent variable and a continu- 
ous dependent variable are involved. An independent samples t-test can be thought of as a special 
case of ANOVA in which the independent variable has only two levels. When more levels exist, 
the t-test alone cannot handle the problem. 
The statistical null hypothesis for ANOVA is stated as follows: 


By By ™ By CEH 


The symbol k is the number of groups or categories for an independent variable. In other words, 
all group means are equal. The substantive hypothesis tested in ANOVA is° 


At least one group mean is not equal to another group mean. 


As the term analysis of variance suggests, the problem requires comparing variances to make 
inferences about the means. 

The Papa Johns example considered locations that were stand-alone and shopping center, com- 
pared to the categorical variable of profitable or not profitable. However, if we knew the exact 
amount of profit or loss for each store, this becomes a good example of a t-test. Specifically, the 


” 


independent variable could be thought of as “location,” meaning either stand-alone or shopping 
center. The dependent variable is the amount of profit/loss. Since only two groups exist for the 
independent variable, either an independent samples t-test or one-way ANOVA could be used. The 


results would be identical. This is shown in the Research Snapshot on the next page. 
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analysis of variance 
(ANOVA) 


Analysis involving the inves- 
tigation of the effects of one 
treatment variable on an interval- 
scaled dependent variable—a 
hypothesis-testing technique to 
determine whether statistically 
significant differences in means 
occur between two or more 
groups. 
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More Than One-Way 
An independent samples t-test is a special case of one-way 
ANOVA. When the independent variable in ANOVA has only two 


groups, the results for an independent samples t-test and ANOVA 


will be the same. 
The two sets of statistical results below demonstrate this fact. 
Both outputs are taken from the same data. The test considers 


Independent Samples f-Test Results: 


whether men or women are more excited 

about a new Italian restaurant in their town. j 
Sex2 is dummy coded so that 0 = menand 4 
1 = women. Excitement was measured on 
a scale ranging from 0 to 6. 


Group Statistics 


Sex2 N Mean Std. Deviation Std. Error Mean 
Excitement 0.00 69 2.64 2.262 0.272 
1.00 73 2.32 2.140 0.250 
Independent Samples Test 
t-Test for Equality of Means 
Levene’s Test 95% Confidence 
for Equality of Interval of the 
Variances Difference 
ee Ce Mean Std. Error 
F Sig. t df Sig. (two-tailed) Difference Difference Lower Upper 
Excitement Equal 1.768 0.186 0.873 140 0.384 0.323 0.369 —0.408 1,053 
variances 
assumed 
Equal 0.872 138.265 0.385 0323 0.370 —0.409 1.054 
variances not 
assumed 


In this case, we would conclude that men and women are equally excited—or unexcited as the case may be. The t of 0.873 with 140 df 


is not significant (p = 0.384). 


ANOVA Results: 
Descriptives 
95% Confidence Interval for 
Mean 
N Mean Std. Deviation Std. Error Lower Bound Upper Bound Minimum Maximum 
Excitement 0.00 69 2.64 2.262 0.272 2.09 3.18 
1.00 73, 232 2.140 0.250 1.82 2.81 
Total 142 2.47 2.198 0.184 A 2.84 0 
ANOVA 
Sum of Squares df Mean Square F Sig. 
Excitement Between Groups 3.692 1 3.692 0.763 0.384 
Within Groups 677.695 140 4.841 
Total 681.387 141 
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Notice that the F-ratio shown in the ANOVA table is associated with the same p-value as is the t-value 
above. This is no accident since the F and t are mathematical functions of one another. So, when two groups are 
involved, the researcher can skin the cat either way! 
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However, assume further that location involved three group levels. Profit would now be 
compared based on whether the store was stand-alone, shopping center, or delivery only. The 
t-test would not be appropriate; one-way ANOVA would be the choice for this analysis. 


Simple Illustration of ANOVA 


ANOVA’ logic is fairly simple. Look at the data table below that describes how much coffee respon- 
dents report drinking each day based on which shift they work, day shift, second shift, or nights. 


J 

S 
“< 

jk 


Second 
Second 
Second 
Second 
Night 
Night 
Night 
Night 
Night 


NOMADDRFPNWNN OC FW 


n 


The following table displays the means for each group and the overall mean: 


Shift Mean Std. Deviation N 
Day 2.00 1.58 5 
Second 4.00 2.94 a 
Night 6.00 1.87 5 
Total 4.00 2.63 14 


Exhibit 22.5 plots each observation with a bar. The long vertical line illustrates the total range of 
observations. The lowest is 0 cups and the highest is 8 cups of coffee for a range of 8. The overall 
mean is 4 cups. Each group mean is shown with a different colored line that matches the bars 


EXHIBIT 22.5 Illustration of ANOVA Logic 


Mean for the 
night shift. 


The overall or “grand” 
mean, as well as 
mean for second shift. 


Mean for the 
day shift. 


Cups 
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grand mean 


The mean of a variable over all 
observations. 


between-groups variance 


The sum of differences between 
the group mean and the grand 
mean summed over all groups 
for a given set of observations. 
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corresponding to the group. The day shift averages 2 cups of coffee a day, the second shift 4 cups, 
and the night shift 6 cups of coffee per day. 

Here is the basic idea of ANOVA. Look at the dark double-headed arrow in Exhibit 22.5. This 
line represents the range of the differences between group means. In this case, the lowest mean is 
2 cups and the highest mean is 6 cups. Thus, the middle vertical line corresponds to the total variation 
(range) in the data and the thick double-headed black line corresponds to the variance accounted 
for by the group differences. As the thick black line accounts for more of the total variance, then the 
ANOVA model suggests that the group means are not all the same, and in particular, not all the same 
as the overall mean. This also means that the independent variable, in this case work shift, explains 
the dependent variable. Here, the results suggest that knowing when someone works explains how 
much coffee they drink. Night-shift workers drink the most coffee. 


Partitioning Variance in ANOVA 
TOTAL VARIABILITY 


An implicit question with the use of ANOVA is, “How can the dependent variable best be 
predicted?” Absent any additional information, the error in predicting an observation is minimized 
by choosing the central tendency, or mean for an interval variable. For the coffee example, if no 
information was available about the work shift of each respondent, the best guess for coffee drinking 
consumption would be four cups. The Sum of Squares Total (SST) or variability that would result 
from using the grand mean, meaning the mean over all observations, can be thought of as 


SST = Total of (Observed Value — Grand Mean)” 


Although the term error is used, this really represents how much total variation exists among the 
measures. 
Using the first observation, the error of observation would be 


(1 cup — 4 cups)” =9 


The same squared error could be computed for each observation and these squared errors totaled 
to give SST. 


BETWEEN-GROUPS VARIANCE 


ANOVA tests whether “grouping” observations explains variance in the dependent variable. In 
Exhibit 22.5, the three colors reflect three levels of the independent variable, work shift. Given 
this additional information about which shift a respondent works, the prediction changes. Now, 
instead of guessing the grand mean, the group mean would be used. So, once we know that some- 
one works the day shift, the prediction would be that he or she consumes 2 cups of coffee per 
day. Similarly, the second and night-shift predictions would be 4 and 6 cups, respectively. Thus, the 
between-groups variance or Sum of Squares Between-groups (SSB) can be found by taking the 
total sum of the weighted difference between group means and the overall mean as shown: 


SSB = Total of n „(Group Mean — Grand Mean)” 


oup 


The weighting factor (n sup) 18 the specific group sample size. Let’s consider the first observation 
once again. Since this observation is in the day shift, we predict 2 cups of coffee will be consumed. 
Looking at the day shift group observations in Exhibit 22.5, the new error in prediction would be 


(2 cups — 4 cups)” = (2) = 4 


The error in prediction has been reduced from 3 using the grand mean to 2 using the group mean. 
This squared difference would be weighted by the group sample size of 5, to yield a contribution 
to SSB of 20. 

Next, the same process could be followed for the other groups yielding two more contribu- 
tions to SSB. Because the second shift group mean is the same as the grand mean, that group’s 
contribution to SSB is 0. Notice that the night-shift group mean is also 2 different than the grand 
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mean, like the day shift, so this group’s contribution to SSB is likewise 20. The total SSB then 
represents the variation explained by the experimental or independent variable. In this case, total 
SSB is 40. The reader may look at the statistical results shown in Exhibit 22.6 to find this value in 
the sums of squares column. 


EXHIBIT 22.6 Interpreting ANOVA 


Tests of Between-Subjects Effects 


(Dependent Variable: Coffee) 


Type Ill Sum Mean 
Source of Squares Square 
Corrected Model 40.000? 2 20.000 4.400 
Intercept 221.538 1 221.538 48.738 
Shift 40.000 2 20.000 4.400 
Error 50.000 11 4.545 
Total 314.000 14 


aR Squared = .444 (Adjusted R Squared = .343) 


95% Confidence Interval 


Std. Error Lower Bound | Upper Bound 


E WITHIN-GROUP ERROR 


Finally, error within each group would remain. Whereas the group means explain the variation 
between the total mean and the group mean, the distance from the group mean and each individual 
observation remains unexplained. This distance is called within-group error or variance or the Sum 
of Squares Error (SSE). The values for each observation can be found by 


SSE = Total of (Observed Mean — Group Mean)” 
Again, looking at the first observation, the SSE component would be 
SSE = (1 cup = 2 cups)” = 1 cup 


This process could be computed for all observations and then totaled. The result would be the 
total error variance—a name used to refer to SSE since it is variability not accounted for by the 
group means. These three components are used in determining how well an ANOVA model 
explains a dependent variable. 


The F-Test 


The F-test is the key statistical test for an ANOVA model. The F-test determines whether there is 
more variability in the scores of one sample than in the scores of another sample. The key ques- 
tion is whether the two sample variances are different from each other or whether they are from 
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within-group error 
or variance 


The sum of the differences 
between observed values and 
the group mean for a given set of 
observations; also known as total 
error variance. 


F-test 


A procedure used to determine 
whether there is more variability 
in the scores of one sample than 
in the scores of another sample. 


546 


total variability 


The sum of within-group 
variance and between-groups 
variance. 
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the same population. Thus, the test breaks down the variance in a total sample and illustrates why 
ANOVA is analysis of variance. 

The F-statistic (or F-ratio) can be obtained by taking the larger sample variance and 
dividing by the smaller sample variance. Using Table A.5 or A.6 in the appendix is much like 
using the tables of the Z- and t-distributions that we have previously examined. These tables 
portray the F-distribution, which is a probability distribution of the ratios of sample variances. 
These tables indicate that the distribution of F is actually a family of distributions that change 
quite drastically with changes in sample sizes. Thus, degrees of freedom must be specified. 
Inspection of an F-table allows the researcher to determine the probability of finding an F as 
large as a calculated F. 


USING VARIANCE COMPONENTS TO COMPUTE F-RATIOS 


In ANOVA, the basic consideration for the F-test is identifying the relative size of variance 
components. The three forms of variation described briefly above are: 


1. SSE—variation of scores due to random error or within-group variance due to individual 
differences from the group mean. This is the error of prediction. 

2. SSB—systematic variation of scores between groups due to manipulation of an experimen- 
tal variable or group classifications of a measured independent variable or between-groups 
variance. 

3. SST—the total observed variation across all groups and individual observations. 


Thus, we can partition total variability into within-group variance (SSE) and between-groups variance 
(SSB). 
The F-distribution is a function of the ratio of these two sources of variances: 
SSB | 
F = (Sse) 
A larger ratio of variance between groups to variance within groups implies a greater value of 
F. If the F-value is large, the results are likely to be statistically significant. 


A DIFFERENT BUT EQUIVALENT REPRESENTATION 


F also can be thought of as a function of the between-groups variance and total variance. 


SSB 
F = f SST SSB) 
In this sense, the ratio of the thick black line to the middle line representing the total range of 
data presents the basic idea of the F-value. Appendix 22A explains the calculations in more detail 
with an illustration. 


Practically Speaking 


Exhibit 22.6 displays the ANOVA result for the coffee-drinking example. Again, one advantage of 
living in modern times is that even a simple problem like this one need not be hand computed. 
Even though this example presents a small problem, one-way ANOVA models with more observa- 
tions or levels would be interpreted similarly. 

The first thing to check is whether or not the overall model F is significant. In this case, the 
computed F = 4.40 with 2 and 11 degrees of freedom. The p-value associated with this value is 
0.039. Thus, we have high confidence in concluding that the group means are not all the same. 
Second, the researcher must remember to examine the actual means for each group to properly 
interpret the result. Doing so, the conclusion reached is that the night-shift people drink the most 
coffee, followed by the second-shift workers, and then lastly, the day-shift workers. 

As there are three groups, we may wish to know whether or not group 1 is significantly 
different than group 3 or group 2, and so on. In a later chapter, we will describe ways of examining 
specifically which group means are different from one another. 


A 
m 


e The key to being an effective business e When we have more than two categories of respondents 
research analyst is not simply learning the (for example, five sales regions) and want to examine the 
analytical tools, but developing the ability differences on their attitudes, perceptions, or any other 
to determine what analytical approach is most variable measured on an interval or ratio level, ANOVA 
appropriate for the circumstances and data. In other is appropriate. ANOVA will show if there is a significant 
words, not only do we need a full box of tools, but we difference in mean scores among the groups. 
also need to understand when and how to use each tool: e Each of these tests determines the statistical significance of 
e When we want to examine relationships with two the differences we observe in our sample. The test indicates 
categorical variables (less-than interval level), cross- if the results we see are unlikely to have occurred by chance. 
tabulations are most often appropriate. The bivariate X? In other words, that the results are present in the population, 
> test examines statistical significance of the relationships not just in the sample, or that they would be repeated if the 
E (distributions) between these variables. test was conducted again. For instance, we might test to see 
z e When we have two categories of respondents (for exam- if the difference between a score of 4.55 for men and 4.67 for 
E ple, gender of the respondent) and want to examine the women is statistically significant. We know that 4.67 is higher 
ry differences on their attitudes, perceptions, or any other than 4.55, but we do not know if it is likely we would observe 
3 variable measured on an interval or ratio level, a t-test is women scoring higher than men if we collected another 
5 appropriate. The t-test will show if there is a significant sample. 
o 
Q 


difference in mean scores between the two groups. 


Summary 


1. Recognize when a particular bivariate statistical test is appropriate. Bivariate statistical tech- 
niques analyze scores on two variables at a time. Tests of difference investigate hypotheses stating 
that two (or more) groups differ with respect to a certain behavior, characteristic, or attitude. 
Both the type of measurement and the number of groups to be compared influence researchers’ 
choices of the type of statistical test. When both variables are less-than interval level, a contin- 
gency table and a x’ test are appropriate. When one variable is less-than interval with two levels 
and the other variable is interval or ratio level, a t-test is appropriate. When one variable is less- 
than interval with three or more levels and the other variable is interval or ratio level, ANOVA 
is the appropriate statistical technique. 


2. Calculate and interpret a x? test for a contingency table. A x? test is used in conjunction with 
cross-classification or cross-tabs. Thus, when an independent variable is ordinal or nominal and 
a dependent variable is likewise ordinal or nominal, a x* test can examine whether a relationship 
exists between the row variable and column variable. A x’ test is computed by examining the 
squared differences between observed cell counts and the expected value for each cell in a con- 
tingency table. Higher x? values are generally associated with lower p-values, meaning a greater 
chance that the relationship between the row and column variable is statistically significant. 


3. Calculate and interpret an independent samples t-test comparing two means. When a 
researcher needs to compare means for a variable grouped into two categories based on some 
less-than interval variable, a t-test is appropriate. An independent samples t-test examines whether 
a dependent variable like job satisfaction differs based on a grouping variable like biological sex. 
Statistically, the test examines whether the difference between the mean for men and women is 
different from 0. A paired-samples t-test examines whether or not the means from two variables 
that are not independent are different. A common situation calling for this test is when the two 
observations are from the same respondent. A simple before-and-after test calls for a paired- 
sample t-test so long as the dependent variable is continuous. 


4. Understand the concept of analysis of variance (ANOVA). ANOVA is the appropriate statistical 
technique to examine the effect of a less-than interval independent variable with three or more 
categories on an at-least interval dependent variable. Conceptually, ANOVA partitions the total 
variability into three types: total variation, between-groups variation, and within-group varia- 
tion. As the explained variance represented by SSB becomes larger relative to SSE or SST, the 
ANOVA model is more likely to be significant, indicating that at least one group mean is different 
from another group mean. 
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5. Interpret an ANOVA table. An ANOVA table provides essential information. Most importantly, 
the ANOVA table contains the model F-ratio. The researcher should examine this value along 
with the corresponding p-value. Generally, as F increases, p decreases, meaning that a statistically 
significant ANOVA model is more likely. 


Key Terms and Concepts 


analysis of variance (ANOVA), 541 independent samples t-test, 534 total variability, 546 

between-groups variance, 544 paired-samples t-test, 539 within-group error or variance, 545 
F-test, 545 pooled estimate of the standard error, 535 Z-test for differences of proportions, 540 
grand mean, 544 test of differences, 530 


Questions for Review and Critical Thinking 


1. What tests of difference are appropriate in the following f. A manager wishes to compare the job performance of a 
situations? salesperson before ethics training with the performance of 
a. Average campaign contributions (in $) of Democrats and that same salesperson after ethics training. 
Republicans are to be compared. 2. Perform a x’ test on the following data: 
b. Average campaign contributions (in $) of Democrats, a. Regulation is the best way to ensure safe products. 


Republicans, and Independents are to be compared. 


c. Human resource managers and chief executive officers Agree Disagree No Opinion 
have responded “yes,” “no,” or “not sure” to an attitude Managers 58 66 8 
question. The HR and CEO responses are to be ifn Employees 34 J i0 
compared. 

Totals 92 90 18 


d. One-half of a sample received an incentive in a mail survey 
while the other half did not. A comparison of response b. Ownership of residence 
rates is desired. 

e. A researcher believes that married men will push the gro- Yes No 


cery cart when grocery shopping with their wives. How Male 25 20 


would the hypothesis be tested? 
Female 16 14 


3. Interpret the following computer cross-tab output including a x’ test. Variable COMMUTE is “How did you get to work last 
week?” Variable GENDER is “Are you male or female?” Comment on any particular problems with the analysis. 


COMMUTE * GENDER Cross-Tabulation 


GENDER 
Female Male Total 
COMMUTE At Home Count 6 10 16 
% within COMMUTE 37.5% 62.5% 100.0% 
% within GENDER 7.0% 17.9% 11.3% 
% of Total 4.2% 7.0% 11.3% 
Bus Count 16 16 32 
% within COMMUTE 50.0% 50.0% 100.0% 
% within GENDER 18.6% 28.6% 22.5% 
% of Total 11.3% 11.3% 22.5% 
Drive Count 32 17 49 
% within COMMUTE 65.3% 34.7% 100.0% 
% within GENDER 37.2% 30.4% 34.5% 
% of Total 22.5% 12.0% 34.5% 


(continued) 


Chapter 22: Bivariate Statistical Analysis: Differences Between Two Variables 549 
COMMUTE * GENDER Cross-Tabulation (continued) 
GENDER 
Female Male Total 
Passenger Count 24 9 33 
% within COMMUTE 72.7% 27.3% 100.0% 
% within GENDER 27.9% 16.1% 23.2% 
% of Total 16.9% 6.3% 23.3% 
Walk Count 8 4 12 
% within COMMUTE 66.7% 33.3% 100.0% 
% within GENDER 9.3% 7.1% 8.5% 
% of Total 5.6% 2.8% 8.5% 
Total Count 86 56 142 
% within COMMUTE 60.6% 39.4% 100.0% 
% within GENDER 100.0% 100.0% 100.0% 
% of Total 60.6% 39.4% 100.0% 
x? Tests a sample of employees are as follows (use your computer and 
statistical software to solve this problem): 
Value df (two-sided) Name pace ana Name pace He 
Pearson Chi-Square 7.751? 4 0.101 
Likelihood Ratio 7.725 0.102 = ji Ti pas ie a 
Mark 5.24 5.51 Susie 4.67 4.50 
MOF Validicases me Jason 5.37 5.42 Ron 4.95 4.40 
a1 cells (10.0%) have expected count less than 5. The minimum expected count is 4.73. Raj 3.69 4.50 Jen 4.00 5.95 
Heidi 5.95 5.90 Matt 3.75 3.50 
4. A store manager’s computer-generated list of all retail sales si a = a pe 


employees indicates that 70 percent are full-time employees, 
20 percent are part-time employees, and 10 percent are furloughed 
or laid-off employees. A sample of 50 employees from the list 
indicates that there are 40 full-time employees, 6 part-time 
employees, and 4 furloughed/laid-off employees. Conduct a sta- 
tistical test to determine whether the sample is representative of 
the population. 

5. Test the following hypothesis using the data summarized in the 
table below. Interpret your result: 


H1: Internet retailers offer lower prices for Blu-ray players than do 
traditional in-store retailers. 


Blu-ray Player 


Average Standard 
Retail Type Price Deviation n 
E-Tailers $371.95 $50.00 25 
Multi-Channel Retailers $360.30 $45.00 25 


6. How does an independent sample t-test differ from the 


following? 

a. one-way ANOVA b. paired-samples t-test 

c. aX? test d. a Z-test for differences 
7. Are t-tests or Z-tests used more often in business research? 

Why? 


8. A sales force received some management-by-objectives training. 
Are the before/after mean scores for salespeople’s job perfor- 
mance statistically significant at the 0.05 level? The results from 


10. 


11. 


12. 


Conduct a Z-test to determine whether the following two sam- 
ples indicate that the population proportions are significantly 
different at the 0.05 level: 


Sample 1 Sample 2 
Sample Proportion 0.77 0.68 
Sample Size 55 46 


In an experiment with wholesalers, a researcher manipulated 
perception of task difficulty and measured level of aspiration 
for performing the task a second time. Group 1 was told the 
task was very difficult, group 2 was told the task was somewhat 
difficult but attainable, and group 3 was told the task was easy. 
Perform an ANOVA on the resulting data: 


Level of Aspiration (10-Point Scale) 


Subjects Group 1 Group 2 Group 3 
1 6 5 5 
2 7 4 6 
3 5 7 5 
4 8 6 4 
5 8 7 2 
6 6 7 3 
Cases 6 6 6 


Interpret the following output examining group differences for 
purchase intentions. The three groups refer to consumers from 
three states: Illinois, Louisiana, and Texas. 


550 Part 6: Data Analysis and Presentation 


Tests of Between-Subjects Effects 
Dependent Variable: int2 


Source Type Ill Sum of Squares df Mean Square F Sig. 
Corrected Model 6681.746? 2 3340.873 3.227 0.043 
Intercept 308897.012 1 308897.012 298.323 0.000 
State 6681.746 2 3340.873 3.227 0.043 
Error 148068.543 143 1035.444 

Total 459697.250 146 

Corrected Total 154750.289 145 


aR Squared = 0.043 (Adjusted R Squared = 0.030) 


Law 
Dependent Variable: int2 


95% Confidence Interval 


State Mean Std. Error Lower Bound Upper Bound 
IL 37.018 4.339 28.441 45.595 
LA 50.357 4.965 40.542 60.172 
TX 51.459 4.597 42.373 60.546 


Research Activities 


1. ETHICS/’NET How ethical is it to do business in different b. Are there differences among the corruption indices in the 
countries around the world? An international organization, past 5 years (between 2003 and 2008)? 
Transparency International, keeps track of the perception 2. ‘NET The Federal Reserve Bank of St. Louis maintains a data- 
of ethical practices in different countries and computes the base called FRED (Federal Reserve Economic Data). Navigate 
corruption perceptions index (CPI).Visit the Web site and search to the FRED database at http://research.stlouisfed.org/fred. 
for the latest CPI (http://www.transparency.org/policy_research/ Randomly select a five-year period between 1970 and 2008 
surveys_indices/cpi/2008). Using the data found here, test the and then compare average figures for U.S. employment in retail 
following research questions. trade with those for U.S. employment in wholesale trade. What 
a. Are nations from Europe and North America perceived statistical tests are appropriate? 


to be more ethical than nations from Asia, Africa, and 
South America? 


Case 22.1 Old School versus New School Sports Fans 


Three academic researchers investigated the idea from old-fashioned American notions of the team before the 
that, in American sports, there are two segments player, sportsmanship, and loyalty above all else, and competition 


ae with opposing views about the goal of com- simply for “love of the game.” 

g g petition (i.e., winning versus self-actualization) New School/Old School was measured by asking agreement 

E 8 and the acceptable/desirable way of achieving with ten attitude statements. The scores on these statements were 

we this goal.’ Persons who believe in “winning at combined. Higher scores represent an orientation toward old school 

any cost” are proponents of sports success as a values. For purposes of this case study, individuals who did not 

product and can be labeled new school (NS) individuals. The new answer every question were eliminated from the analysis. Based on their 
school is founded on notions of the player before the team, loyalty summated scores across the ten items, respondents were grouped into 
to the highest bidder, and high-tech production and consumption low score, middle score, and high score groups. Case Exhibit 22.1—1 
of professional sports. On the other hand, persons who value the shows the SPSS computer output of a cross-tabulation to relate the 


process of sports and believe that “how you play the game matters” gender of the respondent (GENDER) with the New School/Old 
can be labeled old school (OS) individuals. The old school emerges School grouping (OLDSKOOL). 


Chapter 22: Bivariate Statistical Analysis: Differences Between Two Variables 551 


Case Exhibit 22.1-1 SPSS Output 


OLDSKOOL * GENDER Cross-Tabulation 


GENDER 


OLDSKOOL high Count 9 17 26 
% within OLDSKOOL 34.6% 65.4% 100.0% 

% within GENDER 10.6% 9.2% 9.6% 

% of Total 3.3% 6.3% 9.6% 

low Count 45 70 115 

% within OLDSKOOL 39.1% 60.9% 100.0% 

% within GENDER 52.9% 37.8% 42.6% 

% of Total 16.7% 25.9% 42.6% 

middle Count 31 98 129 

% within OLDSKOOL 24.0% 76.0% 100.0% 

% within GENDER 36.5% 53.0% 47.8% 

% of Total 11.5% 36.3% 47.8% 

Total Count 85 185 270 
% within OLDSKOOL 31.5% 68.5% 100.0% 

% within GENDER 100.0% 100.0% 100.0% 

% of Total 31.5% 68.5% 100.0% 


Chi-Square Tests 


Value Asymp. Sig. (2-sided) 
Pearson Chi-Square 6.557? 2 .038 
Likelihood Ratio 6.608 2 .037 
N of Valid Cases 270 


20 cells (0%) have expected count less than 5. The minimum expected count is 8.19. 


Questions 2. Is the analytical approach used here appropriate? 


1. Interpret the computer output. What do the results presented 3. Describe an alternative approach to the analysis of the original 
above indicate? data. Which of these two analyses would you suggest using? 


APPENDIX 22A 


MANUAL 


CALCULATION OF 
AN F-STATISTIC 


EXHIBIT 22A.1 
A Test-Market Experiment 
on Pricing 
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Manual calculations are almost unheard of these days. However, understanding the calculations can 
be very useful in gaining a thorough understanding of ANOVA. The data in Exhibit 22A.1 are 
from a hypothetical packaged-goods company’s test-market experiment on pricing. Three pricing 
treatments were administered in four separate areas (12 test areas, A-L, were required). These data 
will be used to illustrate ANOVA. 

Terminology for the variance estimates is derived from the calculation procedures, so an 
explanation of the terms used to calculate the F-ratio should clarify the meaning of the analysis 
of variance technique. The calculation of the F-ratio requires that we partition the total variation 
into two parts: 


‘Within-group Between-groups 
Total sum of squares = sum ofsquares + sum of squares 
(SST) (SSE) (SSB) 


or 
SST = SSE + SSB 


SST is computed by squaring the deviation of each score from the grand mean and summing these 


SST SS (x, — XY 
where cae 


X = individual score—that is, the ith observation or test unit in the jth group 


squares: 


x= grand mean 

n = number of all observations or test units in a group 

c = number of jth groups (or columns) 

In our example, 
SST = (130 — 119.58)” + (118 — 119.58)” + (87 — 119.58) 
+ (84 — 119.58) + (145 — 119.58) + (143 — 119.58)” 
+ (120 — 119.58)? + (131 — 119.58)? + (153 — 119.58) 
+ (129 — 119.58)” + (96 — 119.58) + (99 — 119.58)” 
= 5,948.93 


Sales in Units (thousands) 


Regular Price, Reduced Price, Cents-Off Coupon, 


$.99 $.89 Regular Price 
Test-Market A, B, or C 130 145 153 
Test-Market D, E, or F 118 143 129 
Test-Market G, H, or | 87 120 96 
Test-Market J, K, or L 84 131 99 
Mean X, = 104.75 X, = 134.75 X, = 119.25 
Grand Mean X = 119.58 
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SSE, the variability that we observe within each group, or the error remaining after using the 


groups to predict observations, is calculated by squaring the deviation of each score from its group 
mean and summing these scores: 


SSE= >) >) (X,- XY 
where 
X = individual score 
X, = group mean for the jth group 


n = number of observations in a group 
c = number of jth groups 


In our example, 


SSE = (130 — 104.75)’ + (118 — 104.75)’ + (87 — 104.75) 


+ (84 — 104.75) + (145 — 134.75) + (143 — 134.75)” 
+ (120 — 134.75) + (131 — 134.75)” + (153 — 119.25) 
+ (129 — 119.25)” + (96 — 119.25) + (99 — 119.25)” 


2 


= 4,148.25 


SSB, the variability of the group means about a grand mean, is calculated by squaring the 
deviation of each group mean from the grand mean, multiplying by the number of items in the 
group, and summing these scores: 


— Oa i T 2 
$sB => A-F) 
j=1 
where 


X, = group mean for the jth group 
X = grand mean 


n, = number of items in the jth group 
J 
In our example, 


SSB = 4(104.75 — 119.58) + 4(134.75 — 119.58)” 
+ 4(119.25 — 119.587 
= 1,800.68 


The next calculation requires dividing the various sums of squares by their appropriate degrees 


of freedom. These divisions produce the variances, or mean squares. To obtain the mean square 
between groups, we divide SSB by c— 1 degrees of freedom: 


_ SSB 
MSB = 74 


In our example, 


1 ; 1 ; 
MSB = a 2 _ 1,800.68 


7 = 900.34 
To obtain the mean square within groups, we divide SSE by cn — c degrees of freedom: 
SSE 
MSE = n= 
In our example, 


4,148.25 _ 4,148.25 91 
MSE = 7457-3 = 9 = 460. 


Finally, the F-ratio is calculated by taking the ratio of the mean square between groups to the 


mean square within groups. The between-groups mean square is the numerator and the within- 
groups mean square is the denominator: 


_ MSB 
F= MSE 
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EXHIBIT 22A.2 
ANOVA Summary Table 


EXHIBIT 22A.3 
Pricing Experiment ANOVA 
Table 
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In our example, 


_ 900.34 


F = 460.91 


= 1.95 


There will be c — 1 degrees of freedom in the numerator and cn — c degrees of freedom in the 
denominator: 


coh. 2S1._ 2 
me 3(4)-3 9 

In Table A.5 in the text appendix, the critical value of F at the 0.05 level for 2 and 9 degrees of 
freedom indicates that an F of 4.26 would be required to reject the null hypothesis. 

In our example, we conclude that we cannot reject the null hypothesis. It appears that all the 
price treatments produce approximately the same sales volume. 

The information produced from an analysis of variance is traditionally summarized in table 
form. Exhibits 22A.2 and 22A.3 summarize the formulas and data from our example. 


Source of Sum of Degrees of Mean 
Variation Squares Freedom Square F-Ratio 
Between groups SSB = Sn Zai e= f MSB = Ea — 
j=1 
Within groups SSE= X X x -X cn—c MSE = 5 p= we 
El ja 


Total Cr= PVD a= il = = 
iIi j= 


where c = number of groups 
n = number of observations in a group 


Source of Sum of Degrees of Mean 

Variation Squares Freedom Square F-Ratio 
Between groups 1,800.68 2 900.34 = 
Within groups 4,148.25 9 460.91 1.953 


Total 5,948.93 11 — — 


APPENDIX 22B 
ANOVA FOR COMPLEX 


EXPERIMENTAL 


To test for statistical significance in a randomized block design, or RBD (see Chapter 12), another ver- 
sion of analysis of variance is utilized. The linear model for the RBD for an individual observation is* 


Y, =u+a +B +e, 
where l 


Y, = individual observation on the dependent variable 


u = grand mean 


R 
| 


= jth treatment effect 
B, = ith block effect 


random error or residual 


The statistical objective is to determine whether significant differences exist among treatment 
means and block means. This is done by calculating an F-ratio for each source of effects. 
The same logic that applies in single-factor ANOVA—using variance estimates to test for dif- 


ferences among means—applies in ANOVA for randomized block designs. Thus, to conduct the 
ANOVA, we partition the total sum of squares (SS) into non-overlapping components. 
SS = SS + SS. + SS 


treatments blocks error 


The sources of variance are defined as follows. 

Total sum of squares: 

=~ 2 
SS oul = >>. (Y, — Y) 
i=1 j=l ` 

where 

y= individual observation 

Y= grand mean 

r = number of blocks (rows) 


c = number of treatments (columns) 


SSi T DO - Yý 


1 jay 
where 


Treatment sum of squares: 


Y = jth treatment mean 


Y = grand mean 


Block sum of squares: 


xII 


j 


-<I 


where 


Y = ith block mean 


i 


SS rocks = Da 
Ses 


Y = grand mean 


Sum of squares error: 


“We assume no interaction effect between treatments and blocks. 


DESIGNS 


555 


556 


ANOVA Table for 
Randomized Block Designs 
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The SS__ may also be calculated in the following manner: 


SS = SS — SS — SS 


error total treatments blocks 


re) 


The degrees of freedom for SS... are equal to c— 1 because SS... reflects the dispersion of treat- 
ment means from the grand mean, which is fixed. Degrees of freedom for blocks are r— 1 for similar 
reasons. SS. reflects variations from both treatment and block means. Thus, df = (r— 1)(c— 1). 
Mean squares are calculated by dividing the appropriate sum of squares by the corresponding 
degrees of freedom. 
Exhibit 22B.1 is an ANOVA table for the randomized block design. It summarizes what has 


been discussed and illustrates the calculation of mean squares. 


Source of Variation Sum of Squares Degrees of Freedom Mean Squares 
SS, 
Between blocks SSi p= 7 À bess 
SS 
Between treatments S e=] Lo 
= 
SS 
Error SS = = error 
error (r WE 1) t= e 1) De 1) 
Total Soe re 1 = 


F-ratios for treatment and block effects are calculated as follows: 


Mean square treatment 


F = 
treatment Mean square error 


Mean square blocks 


E = 
blocks Mean square error 


Factorial Designs 


There is considerable similarity between the factorial design (see Chapter 12) and the one-way 
analysis of variance. The sum of squares for each of the treatment factors (rows and columns) is 
similar to the between-groups sum of squares in the single-factor ANOVA model. Each treatment 
sum of squares is calculated by taking the deviation of the treatment means from the grand mean. 
Determining the sum of squares for the interaction is a new calculation because this source of vari- 
ance is not attributable to the treatment sum of squares or the error sum of squares. 


ANOVA for a Factorial Experiment 
In a two-factor experimental design the linear model for an individual observation is 


Kg Rr ae Lr ee, 


ijk 
where 


individual observation on the dependent variable 
= grand mean 

ith effect of factor B—row treatment 

= jth effect of factor A—column treatment 


= interaction effect of factors A and B 


M 
œ~ R D 
I 


= random error or residual 


Partitioning the Sum of Squares for a Two-Way ANOVA 
Again, the total sum of squares can be allocated into distinct and overlapping portions: 


Sum of Sum of Sum of squares Sum of Sum of 
squares = squares rows F columns + squares + squares 
total (treatment B) (treatment A) interaction error 
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or 
SS cal = SOR esi T SSC amaA + SO aon + SS cot 
Sum of squares total: 
f £ n 
> l > > 52 
SS ora = (Ype E Y) 
1 j=] k=l 
where 
Y „ = individual observation on the dependent variable 
Y = grand mean 
j = level of factor A 
i = level of factor B 
k = number of an observation in a particular cell 
r = total number of levels of factor B (rows) 
c = total number of levels of factor A (columns) 
n = total number of observations in the sample 
Sum of squares rows (treatment B): 
, 
SSR preamen B = >E = Y) 
i=1 
where 
Y = mean of ith treatment—factor B 
Sum of squares columns (treatment A): 
52 
SSC csc 5 > (Y, ~ Y) 
j1 
where 


Y = mean of jth treatment—factor A 


Sum of squares interaction: 


CUO a oat 
=1 j=] k=l 


The above is one form of calculation. However, SS 


interaction 


generally is indirectly computed in 
the following manner: 


= SS 


interaction total 


Sa >> ep- Fy 
1 j=1 ket 


La = mean of the interaction effect 


— SSR 


treatment B 


— SSC — SS 


treatment A error 


Sum of squares error: 


where 


These sums of squares, along with their respective degrees of freedom and mean squares, are sum- 
marized in Exhibit 22B.2. 


Source of Sum of Degrees of 
Variation Squares Freedom Mean Square 
Treatment B SSR = > Reestment 8 MSR seamen 8 
treatment B C MSR E, = r> MS 
SSC, MSC eatmen 
Treatment A SSE Gaal MSC, samena = a WS. tA 
r SS eraction MS macion 
Interaction interaction = We= W) MS eee = (=e) MIS. 
SS 
Error Seno re(n B 1) MSTA z ail 
Total SS rcn — 1 
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After studying this chapter, you should be able to 
1. Apply and interpret simple bivariate correlations 

2. Interpret a correlation matrix 

. Understand simple (bivariate) regression 

. Understand the least-squares estimation technique 


. Interpret regression output including the tests of 
hypotheses tied to specific parameter coefficients 
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Chapter Vignette: Bringing Your Work to Your Home 
(and Bringing Your Home to Work) 


Do you “bring work home”? Do your family experiences and demands affect your work responsi- 
bilities? When you think about the stress you may have faced in a particular work situation, it is 
easy to see how this may, in fact, be the case. 


For many years, there was a belief that employees universally 
separated their work roles from their home/family roles. This belief 
generally centered on the idea that “what happens at home” doesn't 
matter in the workplace. As an employee, you were simply there to 
perform your job, and your family was not part of those responsibili- 
ties. Likewise, the responsibilities you have with your family were not 
affected by work—you left those challenges and stresses “at work.’ 
Our understanding of the work and family interface has changed 
substantially in recent years. 

The idea that work roles and family roles could be at odds with 
one another is nowadays referred to as work-family conflict (WFC).' 

It is typically defined as conflict that results when the demands and 
responsibilities of one role “spill over” into the other role. For example, 
it is easy to see how a manager, simultaneously facing a project dead- 
line and a family reunion in the same week, may allow some of his or 
her frustrations and stress to affect one (or both) of these work and 
family roles. 

There are numerous ways that WFC can be created for an 
employee. Work demands can include inflexible schedules, project 
timelines, and even an abusive supervisor. With regard to family 
demands, any number of family demands can “spill over” into 
the work role, to include child or elder care and dual career 
relationships.’ 

Researchers have begun to examine and explore the many 
different work and family characteristics (i.e. independent variables) 
that can predict WFC (a dependent variable), with the goal of 


providing insights into the causes and consequences of this phenomenon.? Think about 
your own work and family responsibilities. What would be some of the demands on you 
that lead to WFC? How have these demands affected your job satisfaction and/or family 
harmony? It is not hard to see that “bringing home work” is a common problem we face in 


today’s society. 
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Introduction 


When business researchers develop and implement a research survey, it is often conducted with 
several goals in mind. Most important, however, is the goal of answering a particular research ques- 
tion, using survey or other data to justify the result. Finding the “answer” is critically important in 
this regard. This chapter is designed to familiarize you with how business statistics are used to help 
accomplish this task. 


The Basics 


Business research can involve many different professional disciplines. For management, the ques- 
tions regarding conflict, satisfaction, and employee turnover are often key dependent variables of 
interest. As the chapter vignette outlines, this question can be a complex one, with many different 
work and family independent variables affecting work-family conflict. In marketing, sales volume is 
often the dependent variable managers want to predict. Independent variables including marketing- 
mix elements such as price, number of salespeople, and the amount of advertising related to sales 
volume. Uncontrollable variables including population, economic conditions, and competitive 
intensity also affect sales. Most managers would not be surprised to find that sales of baby stroll- 
ers are associated with the number of babies born in each sales period. In this case the depen- 
dent variable is the sales volume of baby strollers, and the independent variable is the number 
of babies born. The mathematical symbol X is commonly used for an independent variable, and 
Y typically denotes a dependent variable. 

The chi-square (x’) test provides information about whether two or more less-than interval 
variables are interrelated. For example, a x” test between a measure of package color and product 
choice provides information about the independence or interrelationship of the two variables. 
Over the years, psychological statisticians have developed several other techniques that demonstrate 
empirical association. 

Exhibit 23.1 on the next page shows that measurement characteristics influence which measure measure of association 


of association is most appropriate. This chapter describes simple correlation (Pearson’s product- A general term that refers to a 
moment correlation coefficient, r) and bivariate or simple regression analysis. Correlation analysis number of bivariate statistical 


is most appropriate for interval or ratio variables. Regression can accommodate either less-than techniques used to measure 
the strength of a relationship 


interval independent variables, but the dependent variable must be continuous. Other techniques 
between two variables. 


mentioned are for advanced students who have specific needs.* 


Simple Correlation Coefficient 


The most popular technique for indicating the relationship of one variable to another is correla- 
tion. A correlation coefficient is a statistical measure of covariation, or association between two correlation coefficient 


variables. Covariance is the extent to which a change in one variable corresponds systematically to A statistical measure of the co- 


a change in another. Correlation can be thought of as a standardized covariance. variation, or association, between 


When correlations estimate relationships between continuous variables, the Pearson product- two at-least interval variables. 


moment correlation is appropriate. The correlation coefficient, r, ranges from —1.0 to +1.0. covariance 


If the value of r equals +1.0, a perfect positive relationship exists. Perhaps the two variables Fhe extent to which two 
are one and the same! If the value of r equals —1.0, a perfect negative relationship exists. The variables are associated system- 
implication is that one variable is a mirror image of the other. As one goes up, the other goes _ atically with each other. 
down in proportion and vice versa. No correlation is indicated if r equals 0. A correlation 

coefficient indicates both the magnitude of the linear relationship and the direction of that 

relationship. For example, if we find that r = —0.92, we know we have a very strong inverse 

relationship—that is, the greater the value measured by variable X, the lower the value mea- 


sured by variable Y. 


variables that you might think would 

be related to a particular outcome for 

a person, such as satisfaction. Based 

upon the variables list, do the following: 

(1) Choose 3 variables (independent vari- 

ables) that you think would predict satisfaction (dependent 
variable); (2) conduct a bivariate correlation analysis for 

all of your selected variables—do they show the correct 
sign (positive or negative)? Are they significantly related? 
(3) Using those same independent and dependent variables, 
conduct a simple regression analysis. What do you find? 


i 
The Survey This! feature contains many Y 


© GEORGE DOYLE 


COURTESY OF QUALTRICS.COM 


Done ae @ Internet Rioo% +. 


EXHIBIT 23.1 

Bivariate Analysis— 
Common Procedures for 
Testing Association 


Interval/Ratio 


Example: Does amount 
of food on plate relate 
to amount eaten? 


Statistical Choice: 
Pearson’s ror simple 
regression 
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The formula for calculating the correlation coefficient for two variables X and Y is as follows: 


n 


Xa- XY- Y) 


i=1 
y Nyx n n 
y Sa- xy Sv y 
i=1 i=1 


where the symbols X and Y represent the sample averages of X and Y, respectively. An alternative 


Tx: 


way to express the correlation formula is 


o 
=, = 
Ney =. Nyx = 
go 
s y 
where 
o? = variance of X 
o? = variance of Y 
a covariance of X and Y 
with 
n 
S X- XY- F) 
i=1 
Oxy = nl 


If associated values of X; and Y; differ from their means in the same direction, their covariance will 
be positive. If the values of X; and Y; tend to deviate in opposite directions, their covariance will 
be negative. 

The Pearson correlation coefficient is a standardized measure of covariance. Covariance 
coefficients retain information about the absolute scale ranges so that the strength of association 
for scales of different possible values cannot be compared directly. Researchers find the correlation 
coefficient useful because they can compare two correlations without regard for the amount of 
variance exhibited by each variable separately. 

Exhibit 23.2 on the next page illustrates the correlation coefficients and scatter diagrams for 
several sets of data. Notice that in the no-correlation condition, the observations are scattered 
rather evenly about the space. In contrast, when correlations are strong and positive, the observa- 
tions lie mostly in quadrants II and IV formed by inserting new axes though X and Y. If correlation 
was strong and negative, the observations would lie mostly in quadrants I and II. 


An Example 


The correlation coefficient can be illustrated with a simple example. Today, researchers do not need 
to calculate correlation manually. However, the calculation process helps illustrate exactly what is 
meant by correlation and covariance. Consider an investigation made to determine whether the 
average number of hours worked in manufacturing industries is related to unemployment. A cor- 
relation analysis of the data is carried out in Exhibit 23.3 on page 563. 

The correlation between the two variables is —0.635, indicating an inverse (negative) relation- 
ship. When number of hours goes up, unemployment comes down. This makes intuitive sense. 
If factories are increasing output, regular workers will typically work more overtime and new 
employees will be hired (reducing the unemployment rate). Both variables are probably related to 
overall economic conditions. 


Correlation, Covariance, and Causation 


Recall that concomitant variation is one condition needed to establish a causal relationship between 
two variables. When two variables covary, they display concomitant variation. This systematic 
covariation does not in and of itself establish causality. Remember that the relationship would also 
need to be nonspurious and that any hypothesized “cause” would have to occur before any subsequent 
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inverse (negative) 
relationship 


Covariation in which the asso- 
ciation between variables is in 
opposing directions. As one goes 
up, the other goes down. 


—Aaron Levenstein 
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Scatter Diagram to Illustrate 
Correlation Patterns 


coefficient of 
determination (R?) 


A measure obtained by squaring 
the correlation coefficient; the 
proportion of the total variance 
of a variable accounted for by 
another value of another variable. 


correlation matrix 


The standard form for reporting 
correlation coefficients for more 
than two variables. 
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effect. Work experience displays a significant correlation with job performance.’ However, in a retail 
context, workers with more experience often get assigned to newer stores. Thus, the researcher 
would need to sort out to what extent age of the store may also be responsible for causing store 
performance. 


Coefficient of Determination 


If we wish to know the proportion of variance in Y that is explained by X (or vice versa), we can 
calculate the coefficient of determination (R?) by squaring the correlation coefficient: 


, _ Explained variance 


Total variance 


The coefficient of determination, R?, measures that part of the total variance of Y that is accounted 
for by knowing the value of X. In the example about unemployment and hours worked, r = —0.635; 
therefore, R? = 0.403.About 40 percent of the variance in unemployment can be explained by the 
variance in hours worked, and vice versa. As can be seen, R-squared really is just r squared! 


Correlation Matrix 


A correlation matrix is the standard form for reporting observed correlations among multiple 
variables. Although any number of variables can be displayed in a correlation matrix, each entry 
represents the bivariate relationship between a pair of variables. Exhibit 23.4 on page 564 shows 
a correlation matrix that relates some measures of salesperson job performance to characteristics 
of the sales force.° 
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EXHIBIT 23.3 Correlation Analysis of Number of Hours Worked in Manufacturing Industries with Unemployment Rate 


Number of 
Unemployment Hours 
Rate Worked a A T Set) 
(X) (Y) i i (Y; — Y? (X: — X(Y;:— Y) 
3 39.6 51 .2601 S .5041 S| 
44 40.7 =e) 3481 29 1521 =o 
4.1 40.4 39 | 09 0081 —.0801 
43 39.8 =) 4761 = .2601 3519; 
6.8 39.2 1.81 3.2761 = ils 12321 = 20091 
55 40.3 5 .2601 =o .0001 = 0051 
55) 297 Si .2601 TS B721 =S 
6.7 39.8 1.71 2.9241 = ll .2601 m3721 
355 40.4 Dl 2601 09 0081 0459 
S 40.5 of 5041 ol) 0361 1349 
52 40.7 21 0441 39 1521 0819 
4.5 41.2 —.49 2401 89 PLO 2A — 4361 
3.8 41.3 =S 1.4161 299) .9801 = eli 
3.8 40.6 =I) 1.4161 29 0841 —.3451 
3.6 40.7 = 1.9321 39 1521 —.5421 
3.5 40.6 —1.49 2.2201 29 .0841 —.4321 
4.9 39.8 nO) 0081 = 05) 2601 0459 
59 39.9 91 8281 —.41 .1681 =E] 
5.6 40.6 61 B721 29 .0841 11769 
X= 4.99 
Y = 40.31 


Y X — XP = 17.8379 
X Y VP = 5.5899 


Y X — X) (Y — Y) = -6.3389 


na DH=NU-¥) = —6.3389 = 63300 
= T /(17.8379)(5.5899) V99.712 
Vox — xp > y, — Y 


Note that the main diagonal consists of correlations of 1.00. Why is this? Simply put, any 
variable is correlated with itself perfectly. Had this been a covariance matrix, the diagonal would 
display the variance for any given variable. 

Performance (S) was measured by identifying the salesperson’s actual annual sales volume in 
dollars. Notice that the performance variable has a 0.45 correlation with the workload variable 
(WL), which was measured by recording the number of accounts in a sales territory. Notice also that 
the salesperson’ perception of job-related tension (JT) as measured by an attitude scale has a —0.48 
correlation with performance (S). Thus, when perceived job tension is high, performance is low. 
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| Pearson Product-Moment Correlation Matrix for Salesperson Example? 


Variables 


Performance (S) 

Job satisfaction (JS) 
Generalized self-esteem (GE) 
Specific self-esteem (SE) 
Other-directedness (OD) 
Verbal intelligence (VI) 
Job-related tension (JT) 
Role ambiguity (RA) 
Territory potential (TP) 


Workload (WL) 


S JS GE SE OD Vi JT RA TP WL 
1.00 
45° 1.00 
si 10 1.00 
61° 282 ag? 1.00 
05 = (05) —.44» —.24¢ 1.00 
= 36) =B .14 Afl 187 1.00 
—.48? = 5 = Ey —.34? .26° = (02 1.00 
=A —.24° =sy) =e! .38° —.05 —44P 1.00 
49° Bile 04 .29° 09 09 38° 262 1.00 
45° alli 29° 29; .04 a2 275 229 49? 1.00 


aNumbers below the diagonal are for the sample; those above the diagonal are omitted. 


’p < 001. 
Tos Olle 
Co) {0)5). 


simple (bivariate) linear 
regression 


A measure of linear association 
that investigates straight-line 
relationships between a continu- 
ous dependent variable and an 
independent variable that is 
usually continuous, but can be a 
categorical dummy variable. 


Researchers are also concerned with statistical significance. The procedure for determining sta- 
tistical significance is the f-test of the significance of a correlation coefficient. Typically it is hypoth- 
esized that r = 0, and then a t-test is performed. The logic behind the test is similar to that for the 
significance tests already considered. Statistical programs usually indicate the p-value associated 
with each correlation and/or star significant correlations using asterisks. The Research Snapshot 
on the next page displays the way correlation matrices are often reported. 


Regression Analysis 


Regression analysis is another technique for measuring the linear association between a depen- 
dent and an independent variable. Although simple regression and correlation are mathemati- 
cally equivalent in most respects, regression is a dependence technique where correlation is an 
interdependence technique. A dependence technique makes a distinction between dependent and 
independent variables. An interdependence technique does not make this distinction and simply is 
concerned with how variables relate to one another. 

Thus, with simple regression, a dependent (or criterion) variable, Y, is linked to an indepen- 
dent (or predictor) variable, X. Regression analysis attempts to predict the values of a continuous, 
interval-scaled dependent variable from specific values of the independent variable. 


The Regression Equation 


The discussion here concerns simple (bivariate) linear regression. Simple regression investigates a 
straight-line relationship of the type 


Y = a + BX, 


where Y is a continuous dependent variable and X is an independent variable that is usually 
continuous, although dichotomous nominal or ordinal variables can be included in the form of 
a dummy variable. Alpha (æ) and beta (B) are two parameters that must be estimated so that the 


COURTESY OF SPSS STATISTICS 17.0. 


ba What Makes Attractiveness? 
"What are the things that make someone 
attractive? Many people are interested in 
this question. Among these are companies that hire 
people to sell fashion. The correlation matrix below 
was computed with SPSS. The correlations show how different 


characteristics related to each other. Variables include a measure of 
fit, meaning how well the person matches a fashion retail concept, 
attractiveness, weight (how overweight someone appears), age, 
manner of dress (how modern), and personality (warm versus cold). 
Thus, a sample of consumers rated a model shown in a photo- 
graph on those characteristics. The results reveal the following: 


Correlations 
Fit Attract Fat Age Modern Cold 
Fit Pearson Correlation 1 0.831** —0.267* 0.108 —0.447** = 05834 
Sig. (2-tailed) 0.000 0.036 0.404 0.000 0.000 
N 62 62 62 62 62 62 
Attract Pearson Correlation 0.831** 1 ero. 0.039 —0.428** 016107" 
Sig. (2-tailed) 0.000 0.030 0.766 0.001 0.000 
N 62 62 62 62 62 62 
Fat Pearson Correlation —O267" 0275" 1 0.082 0.262* 0.058 
Sig. (2-tailed) 0.036 0.030 0.528 0.040 0.653 
N 62 62 62 62 62 62 
Age Pearson Correlation 0.108 0.039 0.082 1 —0.019 0.104 
Sig. (2-tailed) 0.404 0.766 0.528 0.882 0.423 
N 62 62 62 62 62 62 
Modern Pearson Correlation OAN —0.428** 0.262* -0.019 1 0.603** 
Sig. (2-tailed) 0.000 0.001 0.040 0.882 0.000 
N 62 62 62 62 62 62 
Cold Pearson Correlation =O. =O O= 0.058 0.104 0.603** i 
Sig. (2-tailed) 0.000 0.000 0.653 0.423 0.000 
N 62 62 62 62 62 62 


**Correlation is significant at the 0.01 level (2-tailed) 


Thus, if the model seems to “fit” the store concept, she seems 
attractive. If she is too big, she is seen as less attractive. Age is 
unrelated to attractiveness or fit. Modernness and perceived 
coldness also are associated with lower attractiveness. Using 
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these correlations, a retailer can help determine what employees 
should look like! 

Correlations can be found using SPSS by navigating as shown 
below: 
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The Advantage of 
Standardized Regression 
Weights 


standardized regression 
coefficient (£) 


The estimated coefficient indicat- 
ing the strength of relationship 
between an independent vari- 

able and dependent variable 
expressed on a standardized 
scale where higher absolute 
values indicate stronger relation- 
ships (range is from —1 to 1). 
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equation best represents a given set of data. These two parameters determine the height of the 
regression line and the angle of the line relative to horizontal. When these parameters change, the 
line changes. Regression techniques have the job of estimating values for these parameters that 
make the line fit the observations the best. 

The result is simply a linear equation, or the equation for a line, just as in basic algebra! œ rep- 
resents the Y intercept (where the line crosses the Y-axis) and £ is the slope coefficient. The slope is 
the change in Y associated with a change of one unit in X. Slope may also be thought of as rise over 
run: that is, how much Y rises (or falls if negative) for every one unit change in the X-axis. 


Parameter Estimate Choices 


The estimates for œ and £ are the key to regression analysis. In most business research, the estimate 
of 6 is most important. The explanatory power of regression rests with 6 because this is where 
the direction and strength of the relationship between the independent and dependent variable is 
explained. 

A Y-intercept term is sometimes referred to as a constant because @ represents a fixed point. 
An estimated slope coefficient is sometimes referred to as a regression weight, regression coefficient, 
parameter estimate, or sometimes even as a path estimate. The term path estimate is a descriptive term 
adapted because of the way hypothesized causal relationships are often represented in diagrams: 


x 


For all practical purposes, these terms are used interchangeably. 

Parameter estimates can be presented in either raw or standardized form. One potential prob- 
lem with raw parameter estimates is due to the fact that they reflect the measurement scale range. 
So, if a simple regression involved distance measured with miles, very small parameter estimates 
may indicate a strong relationship. In contrast, if the very same distance is measured with centime- 
ters, a very large parameter estimate would be needed to indicate a strong relationship. 

Exhibit 23.5 provides an illustration. Suppose a researcher was interested in how much space was 
allocated to a specific snack food on a shelf and how it related to sales. Fifteen observations are taken 
from 15 different stores. The upper line represents a typical distance showing shelf space measured 
in centimeters. The lower line is the same distance shown in miles. The top frame shows hypo- 
thetical regression results if the independent variable is measured in centimeters. The bottom frame 
shows the very same regression results if the independent variable is measured in miles. Even though 
these two regression lines are the same, the parameter coefficients do not seem comparable. 


125 em 


<> 
II 


Estimated Regression Line: 22 + .07X, 


0.000078 miles 
Estimated Regression Line: Ý = 0.00014 + .0000004x, 


Thus, researchers often explain regression results by referring to a standardized regression 
coefficient (B). A standardized regression coefficient provides a common metric allowing regression 
results to be compared to one another no matter what the original scale range may have been. Due 
to the mathematics involved in standardization, the standardized Y-intercept term is always 0.’ The 
regression equation for the shelf space example would then become: 


Ŷ= 0 + 0.16% 


Even if the distance measures for the 15 observations were converted to some other metric (feet, 
meters, and so on), the standardized regression weight would still be 0.16. 
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Researchers use shorthand to label regression coefficients as either “raw” or “standardized.” 
The most common shorthand is as follows: 


¢ Bor bo = raw (unstandardized) Y-intercept term; what was referred to as œ above. 
¢ B; orb, = raw regression coefficient or estimate. 
e ĝi = standardized regression coefficients. 


RAW REGRESSION ESTIMATES (b,) 


Raw regression weights have the advantage of retaining the scale metric—which is also their key 
disadvantage. Where should the researcher focus then? Should the standardized or unstandardized 
coefficients be interpreted? The answer to this question is fairly simple. 


e Ifthe purpose of the regression analysis is forecasting, then raw parameter estimates must be 
used. This is another way of saying that the researcher is interested only in prediction. 


Thus, when the researcher above wants to predict how much will be consumed based on the amount 
of shelf space, raw regression coefficients must be used. For instance, the forecast for 14 cm of shelf 
space can be found as follows: 


Y= 22 + 0.07(14) = 23.0 


The same result can be found by using the equation representing the distance in miles. 


STANDARDIZED REGRESSION ESTIMATES (£) 


Standardized regression estimates have the advantage of a constant scale. No matter what range of 
values the independent variables take on, B will not be affected. When should standardized regres- 
sion estimates be used? 


e Standardized regression estimates should be used when the researcher is testing explana- 
tory hypotheses; in other words, when the purpose of the research is more explanation than 
prediction. 


Visual Estimation of a Simple Regression Model 


As mentioned above, simple regression involves finding a best-fit line, given a set of observations 
plotted in two-dimensional space. Many ways exist to estimate where this line should go. Estima- 
tion techniques involve terms such as instrumental variables, maximum likelihood, visual estima- 
tion, and ordinary least squares (OLS). We focus on the latter two in this text. 

Suppose a researcher is interested in forecasting sales for a construction distributor (wholesaler) 
in Florida. The distributor believes a reasonable association exists between sales and building per- 
mits issued by counties. Using bivariate linear regression on the data in Exhibit 23.6 on the next 
page, the researcher will be able to explain sales potential (Y) in various counties based on the 
number of building permits (X). 

The data are plotted in a scatter diagram in Exhibit 23.7 on the next page. In the diagram the 
vertical axis indicates the value of the dependent variable, Y, and the horizontal axis indicates the 
value of the independent variable, X. Each single point in the diagram represents an observation of 
X and Y at a given point in time. The values are simply points in a Cartesian plane. 

One way to determine the relationship between X and Y is to simply visually draw the best-fit 
straight line through the points in the figure. That is, try to draw a line that goes through the center 
of the plot of points. If the points are thought of as bowling pins, the best-fit line can be thought 
of as the path that would on average knock over the most bowling pins. For any given value of the 
independent variable, a prediction can be made by selecting the dependent variable that goes along 
with that value. For example, if we want to forecast sales if building permits are 150, we simply 
follow the dotted lines shown in the exhibit to yield a prediction of about 112.The better one can 
estimate where the best-fit line should be, the smaller will be the error in prediction. 
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EXHIBIT 23.6 
Relationship of Sales Y A a 
parentialto Bujang Dealer ee ay 
Permits Issued 
1 7 86 
2 78) 93 
3 80 95 
4 83 104 
5 101 189 
6 Wy 180 
7 129 165 
8 120 147 
9 97 He) 
10 106 182 
11 99) 126 
12 121 156 
3) 103 129 
14 86 96 
15 99 108 
EXHIBIT 23.7 
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ERRORS IN PREDICTION 


Any method of drawing a line can be used to perform regression. However, some methods will 
obviously have more errors than others. Consider our bowling ball line above. One person may be 
better at guessing where it should be than another. We would know who was better by determin- 
ing the total error of prediction. 

Let’s consider error by first thinking about what value of sales would be the best guess if we had 
no information about any other variable. In that case, our univariate best guess would be the mean 
sales of 99.8. If the spot corresponding to 156 building permits (X = 156) were predicted with 
the mean, the resulting error in prediction would be represented by the distance of the gray and 
orange vertical line. 

Once information about the independent variable is provided, we can then use the predic- 
tion provided by the best-fit line. In this case, our best-fit line is the “bowling ball” line shown 
in Exhibit 23.7. The error in prediction using this line would be indicated by the vertical line 
extending up from the regression line to the actual observation. Thus, it appears that at least for this 
observation, our prediction using the regression line has reduced the error in prediction that would 
result from guessing with the mean. Statistically, this is the goal of regression analysis. We would like 
an estimation technique that would place our line so that the total sum of all errors over all obser- 
vations is minimized. In other words, no line fits better. Although with good guess work, visual 
estimation may prove somewhat accurate, perhaps there is a more certain way. 


Ordinary Least-Squares (OLS) 
Method of Regression Analysis 


The researcher’s task is to find the best means for fitting a straight line to the data. OLS is a rela- 
tively straightforward mathematical technique that guarantees that the resulting straight line will 
produce the least possible total error in using X to predict Y. The logic is based on how much 
better a regression line can predict values of Y compared to simply using the mean as a prediction 
for all observations no matter what the value of X may be. 

Unless the dependent and independent variables are perfectly related, no straight line can con- 
nect all observations. More technically, the procedure used in the least-squares method generates a 
straight line that minimizes the sum of squared deviations of the actual values from this predicted 
regression line. With the symbol e representing the deviations of the observations from the regres- 
sion line, no other line can produce less error. The deviations are squared so that positive and nega- 
tive misses do not cancel each other out. The OLS criterion is as follows: 


n 


2. . 
> e; 1S minimum 


ii 


where 
ei = Y; — Y; (the residual) 
Y; = actual observed value of the dependent variable 


Ê, = estimated value of the dependent variable (pronounced “ Y-hat”) 


= number of observations 


3 
| 


i = number of the particular observation 


The general equation for any straight line can be represented as Y = by + b,X. If we think of 
this as the true hypothetical line that we try to estimate with sample observations, the regression 
equation will represent this with a slightly different equation: 


Y, = by + bX, + e; 
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The equation means that the predicted value for any value of X (X;) is determined as a function of 
the estimated slope coefficient, plus the estimated intercept coefficient plus some error. 
The raw parameter estimates can be found using the following formulas: 


> XY) - (> x>) 
(>x) — (Dax) 


by = Y— b X 


b = 


and 


where 


Y; = ith observed value of the dependent variable 
X; = ith observed value of the independent variable 
Y = mean of the dependent variable 

X = independent variable 

X = mean of the independent variable 


n = number of observations 


5 
| 


= intercept estimate 


bı 


slope estimate (regression weight) 


The careful reader may notice some similarity between the correlation calculation and the 
equation for bı. In fact, the standardized regression coefficient from a simple regression equals the 
Pearson correlation coefficient for the two variables. Once the estimates are obtained, a predicted 
value for the dependent variable can be found for any value of X; with this equation: 


Ý, = by + bX; 


Appendix 23A demonstrates the arithmetic necessary to calculate the parameter estimates. 


STATISTICAL SIGNIFICANCE OF REGRESSION MODEL 


As with ANOVA, the researcher needs a way of testing the statistical significance of the regression 
model. Also like ANOVA, an F-test provides the answer to this question. 

The overall F-test for regression can be illustrated with Exhibit 23.7. Once again examine 
the colored line showing the predicted value for X = 156, which represents the small vertical line 
located at the upper right of the exhibit. 


1. The total vertical line including the black and orange segments represent the total deviation of 
the observation from the mean: 


Y,- Y 


2. The black portion represents how much of the total deviation is explained by the regression 
line: 


t= 


3. The orange portion represents how much of the total deviation is not explained by the regres- 
sion line (also equal to e): 


Y-Y 
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These three components are mathematically related because the total deviation is a sum of what 
is explained by the regression line and what is not explained by the regression line. This can be 
expressed mathematically as 


(Y¥,-Y)= (¥,-Y) + (¥,-Y) 


Deviation Deviation 
Total explained by unexplained by 
deviation = the regression + the regression 
(SST) (SSR) (SSE) 


Just as in ANOVA, the total deviation represents the total variation to be explained. Thus, the 
partitioning of the variation into components allows us to form a ratio of the explained variation 
versus the unexplained variation. The corresponding abbreviation for this partitioning is 


SST = SSR + SSE 


An F-test (regression), or an analysis of variance, can be applied to a regression to test the relative F-test (regression) 
magnitudes of the SSR (Sums of Squares — Regression) and SSE (Sums of Squared Errors) with A procedure to determine 
their appropriate degrees of freedom. The equation for the F-test is whether more variability is 


explained by the regression or 
F = SSR/(k — 1) 5 MSR unexplained by the regression. 
“neo = SSE/(n — k) ` MSE 


where 


MSR is an abbreviation for Mean Squared Regression 
MSE is an abbreviation for Mean Squared Error 
k is the number of independent variables (always 1 for simple regression) 


n is the sample size 


Once again, researchers today need not calculate this by hand. Regression programs will pro- 
duce an “ANOVA” table, which will provide the F-value and a p-value (significance level), and 
will generally show the partitioned variation in some form. For the sales example, the following 
table is obtained: 


ANOVA 

df SS MS F p-value 
Regression (SSR) 1 3398.48911 3398.489 91.29854 0.0000003 
Residual (SSE) 13 483.910892 3722291 
Total 14 3882.4 


Thus, building permits explain a significant portion of the variation in sales as evidenced by the 
very low p-value. 


R2 


The coefficient of determination, R?, reflects the proportion of variance explained by the regression 
line. In this example, R? can be found with this formula: 


SSR _ 3398.5 
~ SST ~ 3882.4 


R = 0.875 
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EXHIBIT 23.8 
Simple Regression Results 
for Building Permit Example 


Part 6: Data Analysis and Presentation 


The coefficient of determination may be interpreted to mean that 87.5 percent of the varia- 
tion in sales was explained by associating the variable with building permits. 

What is an “acceptable” R? value? This question is asked frequently. However, guidelines for 
R? values are neither simple nor straightforward. Indeed, good and bad values for the coefficient 
of determination depend on so many factors that a single precise guideline is considered inap- 
propriate. The focus should be on the F-test. However, in practice, do not expect to often see a 
simple regression result with an R? anywhere near the value in this example. They will normally 
be considerably lower.* 


INTERPRETING REGRESSION OUTPUT 


Exhibit 23.8 displays output for the building permit problem. Most computerized software pro- 
vides similar output for regression analysis. Interpreting simple regression output is a simple two- 
step process. 


1. Interpret the overall significance of the model. 

a. The output will include the “model F” and a significance value. When the model F is 
significant (low p-value), the independent variable explains a significant portion of the 
variation in the dependent variable. 

b. The coefficient of determination or R? can be interpreted. As mentioned earlier, this is the 
percentage of total variation in the dependent variable accounted for by the independent 
variable. Another way to think of this is as the extent to which the variances of the inde- 
pendent and dependent variable overlap. 


2. The individual parameter coefficient is interpreted. 

a. The t-value associated with the slope coefficient can be interpreted. In this case, the t of 
9.555 is associated with a very low p-value (0.000 to 3 decimal places). Therefore, the slope 
coefficient is significant. For simple regression, the p-value for the model F and for the 
t-test of the individual regression weight will be the same. 

b. A t-test for the intercept term (constant) is also provided. However, this is seldom of inter- 
est since the explanatory power rests in the slope coefficient. 


Adjusted R | Std. Error of 
R Square Square the Estimate 


cA 6.0114 


a Predictors: (Constant), Permits 


ANOVA(b) 


Sum of 
Squares df Mean Square IF Sig. 


Regression 3398.489 1 3398.489 91.299 .000(a) 
Residual 483.911 13 37.224 

Total 3882.400 14 

a Predictors: (Constant), Permits 

b Dependent Variable: Sales A | 


Coefficients® 
Unstandardized Standardized 
Model Coefficients: Coefficient: 
B Std. Error Beta (B) li Sig. 
1.000 (Constant) 31.502 7.319 4.304 0.001 
Permits 0.546 0.057 0.936 9.555 0.000 


a Dependent Variable: Sales 
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c. Ifaneed to forecast sales exists, the estimated regression equation is needed. Using the raw 
coefficients, the estimated regression line is 
Y= 31.5 + 0.546X 


d. The regression coefficient (slope) indicates that for every building permit issued, sales 
increase 0.546. Moreover, the standardized regression coefficient of 0.936 would allow 
the researcher to compare the explanatory power of building permits versus some other 
potential independent variable. For simple regression, £, equals r. 


PLOTTING THE OLS REGRESSION LINE 


To draw a regression line on the scatter diagram, only two predicted values of Y need to be plotted. 
The data for two dealers is used to illustrate how this is done: 
Dealer 7 (actual Y value = 129): Ê, = 31.5 + 0.546(165) 
= 121.6 


Dealer 3 (actual Y value = 80): Y; = 31.5 + 0.546(95) 
= 83.4 


Using the data for Dealer 7 and Dealer 3, we can draw a straight line connecting the points 121.6 
and 83.4. Exhibit 23.9 shows the regression line. 


OLS Regression Line 


Actual Y 
130 |— for Dealer 7 >* 


YforDealer7  ° 


90 |— Y for 
Dealer 3 ae 


e 
KE Actual Y 
for Dealer 3 
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Size and Weight 
America seems obsessed with weight control. Thin seems to stay 
in and the fight to get thin is a multibillion dollar business. Recall 
in an earlier Research Snapshot correlations between factors 
related to attractiveness were discussed. What if the following 
hypothesis were tested? 


H1: Perceptions that a female model is over- 
weight are related negatively to perceptions of 
attractiveness. 

Using the scales from the earlier Snap- 


shot, this can be tested with a simple regres- 
sion. The results can be summarized as shown here: 


—Anonymous 
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Model Sum of Squares df Mean Square F Sig. 
1 Regression 9.228 1 9227 4.914 0.030 

Residual 112.660 60 1.877 

Total 121.8870968 61 

Unstandardized Standardized 
Coefficients Coefficients 

Model B Std. Error B t Sig. 
1 (Constant) 4.413 0.952 4.636 0.00002 

x113 = 0582 0.262 = 0275 2216 0.030 


The results support the hypothesis. The 
B = —0.275 is both in the expected direc- 
tion (negative) and significant (p < 0.05). 


Therefore, if respondents perceived someone 
as “too fat,’ they likewise saw the person as 
less attractive. 


To determine the error (residual) of any observation, the predicted value of Y is first calculated. 


The predicted value is then subtracted from the actual value. For example, the actual observation 
for dealer 9 is 97, and the predicted value is 96.5; thus only a small margin of error, e = 0.5, is 
involved in this regression line: 


ey =Y,-Y, 
= 97 — 96.5 
= 0.5 


where 


Y, = 31.5 + .546(119) 


SIMPLE REGRESSION AND HYPOTHESIS TESTING 


The explanatory power of regression lies in hypothesis testing. Regression is often used to test 
relational hypotheses. For example, from the chapter vignette, simple regression could be used to 
test the hypothesis relating food quantity to food consumption. 


H1:The amount of food eaten during a meal is related positively to the amount of food placed on a plate. 
In the sales example, the regression addresses a hypothesis linking permits to sales. 
H1: Sales are positively related to the number of building permits. 

The outcome of the hypothesis test involves two conditions that must both be satisfied. 


1. The regression weight must be in the hypothesized direction. Positive relationships require a 
positive coefficient and negative relationships require a negative coefficient. 
2. The t-test associated with the regression weight of the coefficient must be significant. 


In the sales example, both of these conditions are satisfied and the hypothesis would be supported. 
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e When designing a survey, build your e Always conduct a correlational analysis before a regression 
items with the dependent variables you analysis, to get a clearer picture of relationships among all of 
wish to predict in mind. your variables. 
e For many researchers, drawing a diagram of e Remember that in a regression analysis, both the sign of your 
the relationships, and whether they are positively independent variable and its significance level should be 
or negatively related to your dependent variable or reported to your stakeholders. 


variables, can help you clarify what you would hypothesize. 


Summary 


1. Apply and interpret simple bivariate correlations. This chapter covers two approaches for 
studying relationships among two at-least interval variables. A bivariate correlation is an index 
that displays how much two variables covary. Another way to think of correlation is as a standard- 
ized measure of covariance. When two variables display a correlation of 1.0, they are perfectly 
correlated. That means that they have no unique variance. Essentially, they are one and the same. 
When two variables are correlated —1.0 they are perfectly negatively correlated. In this sense they 
are mirror images of one another. Thus, correlations can range between —1.0 and 1.0. Correlations 
near 0 indicate a lack of relationship between two variables. 


2. Interpret a correlation matrix. A correlation matrix presents all possible bivariate correlations 
among a set of variables. The statistical significance of each variable can be tested with a t-test. 
Low p-values for this test indicate significant correlations. Patterns of strong correlations among 
variables indicate variables that share variance in common. 


3. Understand simple (bivariate) regression. Simple linear regression investigates a straight-line 
relationship between one dependent variable and one independent variable. The regression can 
be done intuitively by plotting a scatter diagram of the X and Y points and drawing a line to fit 
the observed relationship. OLS estimation mathematically determines the best-fitting regression 
line for the observed data. The line determined by this method may be used to forecast values of 
the dependent variable, given a value for the independent variable. The line’s goodness-of-fit may 
be evaluated with a variant of the analysis of variance (ANOVA) technique or by calculating the 
coefficient of determination. 


4. Understand the least-squares estimation technique. OLS is an estimation technique that min- 
imizes the least-squared error for all observations. Regression models are evaluated based on how 
much variance they explain. Models with a high SSR relative to SST or SSE explain more vari- 
ance in the dependent variable. SSR represents the proportion of total deviation from the mean 
among observations that can be explained by the regression line. SSE, the sums of square error, 
represents the amount of deviation from the mean for observations that is not accounted for by 
the regression line. OLS fits the line to minimize SSE. 


5. Interpret regression output including the tests of hypotheses tied to specific parameter 
coefficients. Regression results are interpreted in a two-step process. First, the model’s significance 
is evaluated. The model F-ratio, which is a ratio of SSR to SSE, is a key statistic. A significant 
F-ratio means that the independent variable explains a significant portion of the variance in the 
dependent variable. Second, the individual parameter coefficients are evaluated. When the regres- 
sion is run for forecasting purposes, the raw parameter coefficients are most useful. When the 
regression is run for explanatory purposes, the standardized regression weight (8) is most useful. 


Key Terms and Concepts 


coefficient of determination (R°), 562 covariance, 559 measure of association, 559 


correlation coefficient, 559 F-test (regression), 571 


simple (bivariate) linear regression, 564 


correlation matrix, 562 inverse (negative) relationship, 561 standardized regression coefficient (8), 566 
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Part 6: Data Analysis and Presentation 


Questions for Review and Critical Thinking 


What is covariance? 

How are covariance and correlation different? 

How does a researcher determine if a correlation coefficient is 
significant? 

The management of a regional bus line thought the company’s 
cost of gas might be correlated with its passenger/mile ratio. 
The data and a correlation matrix follow. Comment. 


Average Wholesale 

Year Cost of Gas Passengers/Miles 
1 56.5 8.37 

2 59.4 8.93 

3 63.0 9.15 

4 65.6 9.79 

5 89.0 11.20 

Year Price Mile 

Year (r) 1.00000 0.87016 0.95127 
p-value 0.00000 0.05510 0.01280 
Price (r) 0.87016 1.00000 0.97309 
p-value 0.05510 0.00000 0.00530 
Mile (r) 0.95127 0.97309 1.00000 
p-value 0.01280 0.00530 0.00000 


Interpret the following data: 
a. Y= 5.0 + 30X, 
Where the dependent variable equals turnover intentions for 
line managers and the independent variable equals number 
of employees supervised. 
b. Y = 250-4.0X, 
‘NET Where the dependent variable is the number of hits 
on a new banner ad and the independent variable is the 
number of weeks the ad has run. 
What are some different terms used to refer to the slope coef- 
ficient estimated in regression analysis? 
The following ANOVA summary table is the result of a regres- 
sion of sales on year of sales. Is the relationship statistically sig- 
nificant at the 0.95 significance level? Fill in the value for Sums 


of Squares in the SST row. Comment. 


Sourceof Sum of Mean 

Variation Squares d.f. Square F-Value p-value 
SSR 605,370,750 1 605,370,750 3.12 0.115 
SSE 1,551,381,712 8 193,922,714 


SST 9 

Address the following questions about regression analysis: 

a. Define simple linear regression. 

b. When is it most appropriate to rely on raw parameter coef- 
ficients and when is it most appropriate to rely on standard- 
ized parameter coefficients? 

c. Why is the Y-intercept estimate equal to 0 for standardized 
estimates? 

d. What are the steps in interpreting a regression model? 


Research Activities 


‘NET The Federal Reserve Bank of St. Louis maintains a data- 
base called FRED (Federal Reserve Economic Data). Navigate 
to the FRED database at http://www.stls.frb.org/fred/index.html. 
Randomly select a five-year period between 1970 and 2000 and 
then find the correlation between average U.S. employment in 
retail trade and U.S. employment in wholesale trade. Which sta- 
tistical test is appropriate? 


9. 


10. 


The following table gives a football team’s season-ticket sales, 
percentage of games won, and number of active alumni for the 


years 1996—2005. 


Season-Ticket Percentage of Number of 

Year Sales Games Won Active Alumni 
1996 4,995 40 NA 
1997 8,599 54 3,450 
1998 8,479 55 3,801 
1999 8,419 58 4,000 
2000 10,253 63 4,098 
2001 12,457 75 6,315 
2002 13,285 36 6,860 
2003 14,177 27 8,423 
2004 15,730 63 9,000 
2005 15,805 70 9,500 


a. Compute a correlation matrix for the variables. A software 
statistical package is recommended. Interpret the correlation 
between each pair of variables. 

b. Estimate a regression model for sales = Percentage of games 
won. 

c. Estimate a regression model for sales = Number of active 
alumni. 

d. If sales is the dependent variable, which of the two indepen- 
dent variables do you think explains sales better? Explain. 

Are the different forms of consumer installment credit in the 

following table highly correlated? 


Debt Outstanding (millions of dollars) 


Travel and Bank Total Total 
Gas Entertainment Credit Retail Credit Installment 
Year Cards Cards Cards Cards Cards Credit 
1 $ 939 $ 61 $ 828 $9,400 $11,228 $ 79,428 
2 1,119 76 1,312 10,200 12,707 87,745 
3 1,298 110 2,639 10,900 14,947 98,105 
4 1,650 122 3,792 11,500 17,064 102,064 
5 1,804 132 4,490 13,925 20,351 111,295 
6 1,762 164 5,408 14,763 22,097 127,332 
7 1,832 191 6,838 16,395 25,256 147,437 
8 1,823 238 8,281 17,933 28,275 156,124 
9 1,893 273 9,501 18,002 29,669 164,955 
10 1,981 238 11,351 19,052 32,622 185,489 
11 2,074 284 14,262 21,082 37,702 216,572 
11. A manufacturer of disposable washcloths/wipes told a retailer 


12: 


that sales for this product category closely correlated with sales of 
disposable diapers. The retailer thought he would check this out 

for his own sales-forecasting purposes. The researcher says, “Dis- 
posable washcloths/wipes sales can be predicted with knowledge 
of disposable diaper sales.” Is this the right thing to say? 

Explain how OLS determines where a regression line should be 
placed among a plot of observations. 


'NET/ETHICS Go to http://www.transparency.org. Find the corrup- 
tion perception indices for 2005. Go to http://www.geert-hofstede. 
com/hofstede_dimensions.php. Create a data set that includes the 
corruption perception indices for at least 15 countries and the 
score for one of the Hofstede cultural valued dimensions. Con- 
duct a regression and interpret the relationship between cultural 
values and corruption perceptions. 
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Case 23.1 International Operations at CarCare Inc. 


CarCare is considering expanding its operations 


beyond the United States. The company wants 
to know whether it should target countries with 
consumers who tend to have a positive attitude 
toward their current cars. It has gathered data 


© GETTY IMAGES/ 
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l on U.S. and German car owners. The data are 
included in the “car” data set that can be viewed on the Web site at 
http://www.thomsonedu.com/marketing/zikmund (car.sav or car.xls) or 


available from your instructor. Using the data, conduct a correlation and 

simple regression analysis using spending as the dependent variable 

and attitude toward the current car as the independent variable. 

1. Test the hypothesis: Attitude toward one’s car is related posi- 
tively to spending for car-care products. 

2. Would you recommend CarCare do more research to identify 
nations with relatively favorable attitudes toward the cars they own? 
[Note: This data set was referred to for the first time in Chapter 22.] 


APPENDIX 23A 
ARITHMETIC 
BEHIND OLS 


With simple arithmetic, we can solve for the parameter estimates using the OLS equations. Here, 
the data from Exhibit 23.6 are used. The different pieces of the equations are calculated and shown 
in Exhibit 23A.1.To estimate the relationship between the distributor's sales to a dealer and the 
number of building permits, we insert values from the table as shown below: 


n(ZX¥) — (2X) (ZY) 


EXHIBIT 23A.1 Least-Squares Computation 


Y 

1 Z 

2 79 

3 80 

4 83 

5 101 

6 117 

7 129 

8 120 

9 97 

10 106 
11 99 
12 121 
13 103 
14 86 
15 29 
SY= 1,497 

Y= 99.8 
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nm EX- OX)? 
p= 15(193,345) — 2,806,875 
1 — 15(245,759) — 3,515,625 
= 0.546 
n=F-AX 
= 99.8 — 0.546(125) 
= 31.5 
y? X xX? XY 
5,929 86 7,396 6,622 
6,241 93 8,649 7,347 
6,400 95 9,025 7,600 
6,889 104 10,816 8,632 
10,201 139 19,321 14,039 
13,689 180 32,400 21,060 
16,641 165 27,225 21,285 
14,400 147 21,609 17,640 
9,409 119 14,161 11,543 
11,236 132 17,424 13,992 
9,801 126 15,876 12,474 
14,641 156 24,336 18,876 
10,609 129 16,641 13,287 
7,396 96 9,216 8,256 
9,801 108 11,664 10,692 
Dy? = 153,283 2S 1875 DE 245,759 Sve 193,345 
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The formula Y, = 31.5 + 0.546X, is the regression equation used for the prediction of the depen- 
dent variable. Suppose the wholesaler is considering opening a new dealership in an area where 
the number of building permits equals 89. We would need to compute a predicted value for 
X = 89. Sales in this area may be forecasted as 


Y = 31.5 + 0.546(X) 
= 31.5 + 0.546(89) 
= 31.5 + 48.6 
= 80.1 
Thus, the distributor may expect sales of 80.1 (or $80,100) in this new area. 
Calculation of the correlation coefficient gives an indication of how accurate the predictions 


are. In this example the correlation coefficient is r = 0.94 and the coefficient of determination is 
R? = 0.88. 
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CHAPTER 24 
MULTIVARIATE 
STATISTICAL 
ANALYSIS 


After studying this chapter, you should be able to 
1. Understand what multivariate statistical analysis involves 
and know the two types of multivariate analysis 


2. Interpret results from multiple regression analysis 
3. Interpret results from multivariate analysis of variance 


(MANOVA) 
4. Interpret basic exploratory factor analysis results 


5. Know what multiple discriminant analysis can be used to do 
Understand how cluster analysis can identify market 
segments 


o 


Chapter Vignette: Cow-A-Bunga Never 
Goes Out of Style 


As humans, we long to relive the past. This yearning to hold on to the past is a common psycho- 
logical experience.' The psychology of consumption is of interest to many people who are not 
psychologists, however. The fact is, nostalgia sells, and business researchers are very interested 
in understanding exactly what nostalgia is, who is most prone to react to it, and 
how it contributes to business success. 

When a boomer or Gen Xer walks through the toy 


store, he or she is likely to feel right at home. Toy com- 
panies like Hasbro have realized that adults buy toys for 
kids to enjoy. Grown-up consumers like to buy things 
they feel good about. Thus, the toy shelves are filled 
with throwback versions of GI Joe, Barbie, and even the 
Teenage Mutant Ninja Turtles.? The game shelves are filled 
with classic versions of familiar games like Risk, Stratego, 
and Monopoly. 
Not to be outdone, other marketers are also counting 
on nostalgic consumers. Appliance companies have turned 
to retro designs with classic 1950s versions of toasters, 
blenders, and even ovens.’ Advertisers are also using nostal- 
gia to produce more effective sales appeals. Among others, 
Coca-Cola has used nostalgic advertising to help consumers 


relive the past.’ 
This trend is expected to continue, as pointed out by 


Janet Hsu, President of Sanrio Global Consumer Products, 
“Inspirational products will be a major trend in 2009 as consum- 
ers gravitate towards purchasing products that provide comfort 


and emotional connection. Evergreen and nostalgic products will continue to sell well. . . $ 
How can organizations better integrate nostalgia into their business plans? Researchers are 


o 
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working on numerous issues related to nostalgia: 


e How can nostalgia be measured? 

e What emotions is nostalgia associated with?” 

Can market segments be defined based on the type and amount of nostalgia experienced? 
What happens to consumers when they experience nostalgia? 

What makes a nostalgic consumer different from one who does not experience nostalgia? 
What are the positive outcomes for the business when consumer nostalgia increases? 
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Chapter 24: Multivariate Statistical Analysis 


Nostalgia is a complex experience involving multiple thoughts and feelings. The complexity makes 
nostalgia somewhat difficult to study. Multivariate research procedures can help address these ques- 
tions as they consider the effects of multiple variables simultaneously. However, it seems that nostal- 
gic thoughts mean good vibes for the marketer.’ Cow-a-bunga! 


Introduction 


If only business problems were really as simple as most textbook examples! Most coursework involves 
solving problems that have a definite answer. They are usually relatively well-defined problems in 
which the information provided in the problem can be used to produce one correct solution. 
Unfortunately, in the real world, most business problems are ill-defined. Not only do they not 
have a definite answer, but generally information needs to be generated and massaged before any 
solution can be obtained. Therefore, most business research studies involve many variables that must 
be organized for meaning. As researchers become increasingly aware of the complex nature of busi- 
ness problems, they gain a greater appreciation for more sophisticated approaches to data analysis. This 
chapter provides an introduction to some forms of what are known as multivariate data analysis. 


What Is Multivariate Data Analysis? 


The preceding chapters have addressed univariate and bivariate analyses. Research that involves 
three or more variables, or that is concerned with underlying dimensions among multiple variables, 
will involve multivariate statistical analysis. Multivariate statistical methods analyze multiple variables 
or even multiple sets of variables simultaneously. How do we know when someone has experienced 
nostalgia and whether or not the experience has altered behavior? Nostalgia itself is a latent con- 
struct that involves multiple indicators that together represent nostalgia. As such, the measurement 
and outcomes of nostalgia lend themselves well to multivariate analysis.’ Likewise, many other 
business problems involve multivariate data analysis including most employee motivation research, 
customer psychographic profiles, and research that seeks to identify viable market segments. 


The “Variate” in Multivariate 


Another distinguishing characteristic of multivariate analysis is the variate. The variate is a math- 
ematical way in which a set of variables can be represented with one equation. A variate is formed 
as a linear combination of variables, each contributing to the overall meaning of the variate based 
upon an empirically derived weight. Mathematically, the variate is a function of the measured 
variables involved in an analysis: 


SF Xp X) 


m 


V, is the kth variate. Every analysis could involve multiple sets of variables, each represented by 
a variate. X, to X represent the measured variables. 

Here is a simple illustration. Recall that constructs are distinguished from variables by the 
fact that multiple variables are needed to measure a construct. Let’s assume we measured nostalgia 
with five questions on our survey. With these five variables, a variate of the following form could 
be created: 


y, = LX, + LX, T LX, P LX, t LX; 


V, represents the score for nostalgia, X, to X, represent the observed scores on the five scale items 
(survey questions) that are expected to indicate nostalgia, and L, to L, are parameter estimates much 
like regression weights that suggest how highly related each variable is to the overall nostalgia score. 
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variate 


A mathematical way in which 
a set of variables can be repre- 
sented with one equation. 


COURTESY OF QUALTRICS.COM 


Our survey includes data that can best be analyzed with When reading the chapter, consider these 


multivariate techniques. Take a look at the survey ques- questions and how they fit with the techniques 
tions that deal with satisfaction with the business school described. When you have finished the chapter: 
experience. 


1. Runa factor analysis on the 8 questions from 
“Teacher's Knowledge of Topics” through “Your 
Overall Academic Performance” 
a. How many factors are retained? 
b. What would you “name” these factors? 
c. Create summated scale for each factor. 


2. Runa multiple regression analysis with the Overall 
Experience question as the dependent measure and the 
summed scale(s) as the independent measure(s). Also 
include sex of the respondent as an independent vari- 
able (dummy variable) in your regression. Interpret the 
results: 

a. Is the overall model significant? 

b. Which of the independent variables are significant? 

c. How much variance in Overall Experience is 
explained by the predictor variables? 

d. Which of the independent variables is most important 
in determining satisfaction with the Overall Experience? 
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While this equation might appear a little intimidating, don’t worry! We do not have to manu- 
ally calculate these scores. We’ll rely on the computer to do the heavy lifting. However, this type of 
relationship is common to multivariate procedures. 


Classifying Multivariate Techniques 


Exhibit 24.1 presents a very basic classification of multivariate data analysis procedures. Two basic 
groups of multivariate techniques are dependence methods and interdependence methods. 


EXHIBIT 24.1 
Which Multivariate Approach 
Is Appropriate? 


Dependence Interdependence 
methods K methods 
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Dependence Techniques 


When hypotheses involve distinction between independent and dependent variables, dependence 
techniques are needed. For instance, when we hypothesize that nostalgia is related positively to 
purchase intentions, nostalgia takes on the character of an independent variable and purchase 
intentions take on the character of a dependent variable. Predicting the dependent variable “sales” 
on the basis of numerous independent variables is a problem frequently investigated with depen- 
dence techniques. Multiple regression analysis, multiple discriminant analysis, multivariate analysis of vari- 
ance, and structural equations modeling are all dependence methods. 


Interdependence Techniques 


When researchers examine questions that do not distinguish between independent and dependent 
variables, interdependence techniques are used. No one variable or variable subset is to be predicted 
from or explained by the others. The most common interdependence methods are factor analysis, 
cluster analysis, and multidimensional scaling. A manager might utilize these techniques to determine 
which employee motivation items tend to group together (factor analysis), to identify profitable 
customer market segments (cluster analysis), or to provide a perceptual map of cities being consid- 
ered for a new plant (multidimensional scaling). 


Influence of Measurement Scales 


As in other forms of data analysis, the nature of the measurement scales will determine which 
multivariate technique is appropriate for the data. Exhibits 24.2 and 24.3 on the next page show 
that selection of a multivariate technique requires consideration of the types of measures used for 
both independent and dependent sets of variables. These exhibits refer to nominal and ordinal 
scales as nonmetric and interval and ratio scales as metric. 


Multiple 
independent 
and dependent 
variables 


Structural 
Equation 
Modeling 


Multiple 
regression 
analysis 


Multiple 
discriminant 
analysis 
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dependence techniques 


Multivariate statistical techniques 
that explain or predict one or 
more dependent variables. 


interdependence 
techniques 


Multivariate statistical techniques 
that give meaning to a set of 
variables or seek to group things 
together; no distinction is made 
between dependent and inde- 
pendent variables. 


EXHIBIT 24.2 

Which Multivariate 
Dependence Technique 
Should I Use? 
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EXHIBIT 24.3 
Which Multivariate 
Interdependence Technique 
Should I Use? 


general linear model (GLM) 


A way of explaining and predict- 
ing a dependent variable based 
on fluctuations (variation) from 
its mean. The fluctuations are 
due to changes in independent 
variables. 


multiple regression 
analysis 


An analysis of association in 
which the effects of two or more 
independent variables on a 
single, interval-scaled dependent 
variable are investigated 
simultaneously. 
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Nonmetric 


Metric Nonmetric 
multidimensional 


scaling 


Cluster 
analysis 


Factor 


multidimensional 


analysis scaling 


Analysis of Dependence 


Multivariate dependence techniques are variants of the general linear model (GLM). Simply, the 
GLM is a way of modeling some process based on how different variables cause fluctuations from 
the average dependent variable. Fluctuations can come in the form of group means that differ from 
the overall mean as in ANOVA or in the form of a significant slope coefficient as in regression. The 
basic idea can be thought of as follows: 
Ê = u + AX + AF + AXF 

Here, u represents a constant, which can be thought of as the overall mean of the dependent 
variable, AX and AF represent changes due to main effect independent variables (such as experi- 
mental variables) and blocking independent variables (such as covariates or grouping variables), 
respectively, and AXF represents the change due to the combination (interaction effect) of those 
variables. Realize that Y, in this case could represent multiple dependent variables, just as X and F 
could represent multiple independent variables. Multiple regression analysis, n-way ANOVA, and 
MANOVA represent common forms that the GLM can take. 


Multiple Regression Analysis 


Multiple regression analysis is an extension of simple regression analysis allowing a metric depen- 
dent variable to be predicted by multiple independent variables. Chapter 23 illustrated simple 
linear regression analysis with an example explaining a construction dealer’s sales volume with 
the number of building permits issued. Thus, one dependent variable (sales volume) is explained 
by one independent variable (number of building permits). Yet reality is more complicated and 
several additional factors probably affect construction equipment sales. Other plausible indepen- 
dent variables include price, seasonality, interest rates, advertising intensity, consumer income, and 
other economic factors in the area. The simple regression equation can be expanded to represent 
multiple regression analysis: 


Y= b, + bX, + bX, + bX, + + OX +e, 
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Thus, as a form of the GLM, dependent variable predictions (Y) are made by adjusting the constant 
(b.), which would be equal to the mean if all slope coefficients are 0, based on the slope coefficients 
associated with each independent variable (b,, b,,..., b). 

Less-than interval (nonmetric) independent variables can be used in multiple regression. This can 
be done by implementing dummy variable coding. A dummy variable is a variable that uses a 0 and a 
1 to code the different levels of dichotomous variable (for instance, residential or commercial building 
permit). Multiple dummy variables can be included in a regression model. For example, dummy cod- 
ing is appropriate when data from two countries are being compared. Suppose the average labor rate 
for automobile production is included in a sample taken from respondents in the United States and in 
South Korea.A response from the United States could be assigned a 0 and responses from South Korea 
could be assigned a 1 to create a country variable appropriate for use with multiple regression. 


A SIMPLE EXAMPLE 


Assume that a toy manufacturer wishes to explain store sales (dependent variable) using a sample 
of stores from Canada and Europe. Several hypotheses are offered: 


e H1: Competitor’s sales are related negatively to our firm’s sales. 

e H2: Sales are higher in communities that have a sales office than when no sales office is 
present. 

e H3: Grammar school enrollment in a community is related positively to sales. 


Competitor’s sales is how much the primary competitor sold in the same stores over the same time 
period. Both the dependent variable and the competitor’s sales are ratio variables measured in euros 
(Canadian sales were converted to euros). The presence of a sales office is a categorical variable that 
can be represented with dummy coding (0 = no office in this particular community, 1 = office in this 
community). Grammar school enrollment is also a ratio variable simply represented by the number of 
students enrolled in elementary schools in each community (in thousands).'' A sample of 24 commu- 
nities is gathered and the data are entered into a regression program to produce the following results: 


Regression equation: Y = 102.18 + 0.387X, + 115.2X, + 6.73X, 
Coefficient of multiple determination (R?) = 0.845 
F-value = 14.6; p < 0.05 


Note that all the signs in the equation are positive. Thus, the regression equation indicates 
that sales are positively related to X,, X,, and X,.The coefficients show the effect on the depen- 
dent variable of a 1-unit increase in any of the independent variables. The value or weight, b,, 
associated with X, is 0.387. Thus, a one-unit increase ($1,000) in competitors’ sales volume (X,) 
in the community is actually associated with an increase of $387 in the toy manufacturer’s sales 
(0.387 X $1,000 = $387).The value of b, = 115.2, which indicates that an increase of $115,200 
(115.2 thousand) in toy sales is expected with each additional unit of X,. Thus, it appears that 
having a company sales office in a community is associated with a very positive effect on sales. 
Grammar school enrollments also may help predict sales. An increase of 1 unit of enrollment 
(1,000 students) indicates a sales increase of $6,730. 

Because the effect associated with X, is positive, H1 is not supported; as competitor sales increase, 
our sales increase as well. The effects associated with H2 and H3 are also positive, which is in the hypoth- 
esized direction. Thus, if the coefficients are statistically significant, H2 and H3 will be supported. 


REGRESSION COEFFICIENTS IN MULTIPLE REGRESSION 


Recall that in simple regression, the coefficient b, represents the slope of X on Y. Multiple regres- 
sion involves multiple slope estimates, or regression weights. One challenge in regression models 
is to understand how one independent variable affects the dependent variable, considering the 
effect of other independent variables. When the independent variables are related to each other, 
the regression weight associated with one independent variable is affected by the regression weight 
of another. Regression coefficients are unaffected by each other only when independent variables 
are totally independent. 
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dummy variable 


The way a dichotomous (two 
group) independent variable is 
represented in regression analysis 
by assigning a 0 to one group 
and a 1 to the other. 
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partial correlation 


The correlation between two 
variables after taking into 
account the fact that they 
are correlated with other 
variables too. 
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Conventional regression programs can provide standardized parameter estimates, B, B,,and so 
on, that can be thought of as partial regression coefficients. The correlation between Y and X,, control- 
ling for the correlation that X, has with the Y, is called partial correlation. Consider a standardized 
regression model with only two independent variables:'* 


Y= BX, + BX, + e, 


The coefficients B, and $, are partial regression coefficients, which express the relationship between 
the independent variable and dependent variable taking into consideration that the other variable 
also is related to the dependent variable. As long as the correlation between independent variables 
is modest, partial regression coefficients adequately represent the relationships. When the correla- 
tion between two independent variables becomes high, the regression coefficients may not be 
reliable, as illustrated in the Research Snapshot on the next page. 

When researchers want to know which independent variable is most predictive of the depen- 
dent variable, the standardized regression coefficient (8) is used. One huge advantage of $ is that it 
provides a constant scale. In other words, the Bs are directly comparable. Therefore, the greater the 
absolute value of the standardized regression coefficient, the more that particular independent vari- 
able is responsible for explaining the dependent variable. For example, suppose in the toy example 
above, the following standardized regression coefficients were found: 


B, = 0.10 
B, = 0.30 
B, = 0.10 


The resulting standardized regression equation would be 
Y = 0.10X, + 0.30X, + 0.10X, + e, 


Using standardized coefficients, the researcher concludes that the relationship between competi- 
tor’s sales (X,) and company sales (Y) is the same strength as is the relationship between grammar 
school enrollment (X,) and company sales. Perhaps more important, though, the conclusion can 
also be reached that the relationship between having a sales office in the area (X,) and sales is three 
times as strong as the other two relationships. Thus, management may wish to place more emphasis 
on locating sales offices in major markets. 


R? IN MULTIPLE REGRESSION 


The coefficient of multiple determination in multiple regression indicates the percentage of varia- 
tion in Y explained by the combination of all independent variables. For example, a value of 
R? = 0.845 means that 84.5 percent of the variance in the dependent variable is explained by 
the independent variables. If two independent variables are truly independent (uncorrelated with 
each other), the R? for a multiple regression model is equal to the separate R? values that would 
result from two separate simple regression models. More typically, the independent variables are 
at least moderately related to one another, meaning that the model R? from a multiple regression 
model will be less than the separate R? values resulting from individual simple regression models. 
This reduction in R? is proportionate to the extent to which the independent variables exhibit 
multicollinearity. 


STATISTICAL SIGNIFICANCE IN MULTIPLE REGRESSION 


Following from simple regression, an F-test is used to test statistical significance by comparing the 
variation explained by the regression equation to the residual error variation. The F-test allows for 
testing of the relative magnitudes of the sum of squares due to the regression (SSR) and the error 
sum of squares (SSE). 


(SSR) /k MSR 
~ (SSE)/(n—k-1) ~~ MSE 


F 
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+ ba: Too Much of a Good Thing! 
Researchers often test hypotheses by 
examining regression coefficients. Thus, 
we are often looking for correlations, sometimes 
in all the wrong places. Financial data can be 
problematic to analyze. Consider the case of a financial manager 
trying to analyze gross margin (dependent variable = margin per 
employee) using the following independent variables: 


e Average sales per square foot per quarter 
e Average labor costs per week 


ANOVA(b) 

Model Sum of Squares df 

1 Regression 142566.5332 4 
Residual 91934.43848 35 
Total 234500.9717 39 


e Years of experience for the manager 
e Job performance rating for the previous year (100-point scale) 


Regression results can be obtained in SPSS by clicking on 
ANALYZE, REGRESSION, and then LINEAR. The VIF column must 
be requested by clicking on STATISTICS and then checking 
COLLINEARITY DIAGNOSTICS. After doing so, the following 
results are obtained. For the overall model, 


Mean Square F Sig. 
35641.6333 13.56899 .0000008 
2626.698242 


A Predictors: (constant), performance, experience, labor, sales 


B Dependent Variable: margin 


The F of 13.57 is highly significant (<0.001), so the variables 
explain a large portion of the variance in the dependent variable. 


Coefficients(a) 


Unstandardized 


Model Coefficients B Std. Error 

1 (Constant) 171.242614 235.9374392 
Sales 0.090784631 0.030835442 
Labor —(0.070267446 0.035014493 
Experience —(0.488078747 0.955764142 
Performance —1.856084354 3.034080822 


a Dependent Variable: margin 


Even though the model results appear strong, only one inde- 
pendent variable is significant at a Type | error rate of 0.050 — 
sales. However, the B coefficients do not make sense. 

The B coefficients for both sales and labor are beyond the range 
that B should theoretically take (— 1.0 to 1.0). Nothing can be 
correlated with something more than perfectly (which would 
be a correlation of 1.0 or — 1.0). Notice also that the two VIF fac- 
tors for sales and labor are in the 50s. Generally, when multiple 
VIF factors approach 5 or greater, problems with multicollinear- 
ity can be expected. The high correlation between sales and 


The model R? is 0.61 also supporting this conclusion. The results 
for the independent variable tests show the following: 


Standardized 


Coefficients 
Beta t Sig. VIF 
0.725797 0.47279 
2.339759409 2.944165 0.00572 56.3836 
—1.587938574 — 2.00681 0.05254 55.8971 
—0.054331204 — 0.51067 0.61279 1.0105 
—0.068978263 —0.61175 0.54466 1.1351 


labor is a problem illustrating multicollinearity. Multicollinearity 
(sometimes just referred to as collinearity) in regression analysis 
refers to how strongly interrelated the independent variables in a 
model are. 

As often occurs with financial data, they can be difficult to 
use as independent variables. 
In this case, the researcher 
may wish to rerun the model 
after dropping one of the 
offending variables. 
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multicollinearity 


The extent to which independent 
variables in a multiple regression 
analysis are correlated with each 
other; high multicollinearity can 

make interpreting parameter esti- 

mates difficult or impossible. 
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where 


k = number of independent variables 
n = number of observations 

MSR = Mean Squares Regression 

MSE = Mean Squares Error 


Degrees of freedom for the F-test (df) are: 


df for the numerator = k 


df for the denominator = n-k- 1 
For our toy sales example, 
df (numerator) = 3 
df (denominator) = 24-3 -1 = 20 


In the toy example, we have 24 observations (different communities) and 3 independent variables 
(competitor sales, sales office, and school enrollment). A table of critical F-values shows that for 3 
and 20 df, and a 0.05 Type I error rate, a value of 3.10 or more is necessary for the regression model 
to be considered significant, meaning that it explains a significant portion of the total variation in 
the dependent variable. In practice, statistical programs will report the p-value associated with the 
F-test directly. Similarly, the programs report the statistical test for each individual independent 
variable. Independent variables with p-values below the acceptable Type I error rate are considered 
significant predictors of the dependent variable. 


STEPS IN INTERPRETING A MULTIPLE REGRESSION MODEL 


Multiple regression models often are used to test some proposed theoretical model. For instance, 
a researcher may be asked to develop and test a model explaining business unit performance. Why 
do some business units outperform others? Multiple regression models can be interpreted using 
these steps: 


1. Examine the model F-test. If the test result is not significant, the model should be dismissed and 
there is no need to proceed to further steps. 

2. Examine the individual statistical tests for each parameter estimate. An independent variable 
with significant results can be considered a significant explanatory variable. If an independent 
variable is not significant, the model should be run again with nonsignificant predictors deleted. 
Often, it is best to eliminate predictor variables one at a time, then rerun the reduced model. 

3. Examine the model R?. No cutoff values exist that can distinguish an acceptable amount of 
explained variation across all regression models. However, the absolute value of R? is more 
important when the researcher is more interested in prediction than in explanation. In other 
words, the regression is run for pure forecasting purposes. When the model is more oriented 
toward explanation of which variables are most important in explaining the dependent vari- 
able, cutoff values for the model R? are not really appropriate. 

4. Examine collinearity diagnostics. Multicollinearity in regression analysis refers to how strongly 
interrelated the independent variables in a model are. When multicollinearity is too high, the 
individual parameter estimates become difficult to interpret. Most regression programs can 
compute variance inflation factors (VIF) for each variable. As a rule of thumb, VIF above 5.0 
suggests problems with multicollinearity.'° 


Exhibit 24.4 illustrates these steps. The regression model explains business unit profitability 
for a sample of 28 business units for a Fortune 500 company. The independent variables are hours 
(average hours spent in training for the workforce), budget (the percentage of the promotional 
budget used), and state (a dummy variable indicating whether the business unit is in Arizona and 
coded 0, or in Ohio and coded 1). In this case, the researcher is using a maximum acceptable Type I 
error rate of 0.05. The conclusion reached from this analysis is that hours spent in training seem 
to pay off in increased business unit profitability as evidenced by the significant, positive regression 
coefficient (B = 0.55, p < 0.05). 
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EXHIBIT 24.4 Interpreting Multiple Regression Results 


The SAS System 


The REG Procedure 
Model: MODEL1 


Dependent Variable: Paid 
Number of Observations Read 28 
Number of Observations Used 28 


Analysis of Variance 


Sum of Mean 

Source DF Squares Square F Value Ieie 215 
Model 3 1770668 590223 IE). SMS) <.0001 
Error 24 73 TOB5 30460 
CorrectediTotal BY 2501703 

Root MSE 174 .52738 R-Square 0.7078 

Dependent Mean 654.03571 Adj R-Sq O.6 7113 

Cosmi Wee 26.68469 


Parameter Estimates 


Parameter Standard Standardized 
Variable DF Estimate Error t Value Baga Estimate VIF 
MiMESTESSIONE alt =O. 90538) 217.46253 FOLS OELH 0 
Hours 1 0.99438 0.27688 3759 0.0015 0.55433 12S 
Budget dL 6.60121 3.54784 1.86 ORO Sal 0.28210 i 139) 
State 1 —66 86397 84.82434 OLE 0.4416 =O LO GS 


ANOVA (n-Way) and MANOVA 


As discussed above, regression is a form of the GLM with a single continuous dependent measure 

and continuous independent measure(s). An ANOVA or MANOVA model also represents a form of 

the GLM. ANOVA can be extended beyond one-way ANOVA to predict a continuous dependent 

variable with multiple categorical independent variables. Multivariate analysis of variance (MANOVA), multivariate analysis of 
is a multivariate technique that predicts multiple continuous dependent variables with multiple variance (MANOVA) 
independent variables. The independent variables are categorical, although a continuous control A multivariate technique that 


variable can be included in the form of a covariate. Statistical programs usually refer to any ANOVA predicts multiple continuous 
dependent variables with mul- 
tiple categorical independent 
variables. 


with only one dependent variable as univariate analysis of variance or simply as ANOVA. 


E N-WAY (UNIVARIATE) ANOVA 


The interpretation of an n-way ANOVA model follows closely from the regression results described 
above. The steps involved are essentially the same with the addition of interpreting differences 
between means: 


1. Examine the overall model F-test result. If significant, proceed. 
2. Examine individual F-tests for each individual independent variable. 
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discriminant analysis 


A Statistical technique for predict- 
ing the probability that an object 
will belong in one of two or more 
mutually exclusive categories of 
the dependent variable, based 
on several independent variables. 
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3. For each significant categorical independent variable, interpret the effect by examining the 
group means (see Chapter 12). 

4. For each significant continuous variable (covariate), interpret the parameter estimate (b). 

5. For each significant interaction, interpret the means for each combination. A graphical repre- 
sentation as illustrated in Chapter 12 can greatly assist in this interpretation. 


INTERPRETING MANOVA 


Compared to ANOVA, a MANOVA model produces an additional layer of testing. The first layer 
of testing involves the multivariate F-test, which is based on a statistic called Wilke’s Lambda (A). 
This test examines whether or not an independent variable explains significant variation among 
the dependent variables within the model. If this test is significant, then the F-test results from 
individual univariate regression models nested within the MANOVA model are interpreted. The 
rest of the interpretation results follow from the one-way ANOVA or multiple regression model 
results above. The Research Snapshot on the next page provides an example of how to run and 
interpret MANOVA. 


Discriminant Analysis 


Researchers often need to produce a classification of sampling units. This process may involve using 
a set of independent variables to decide if a sampling unit belongs in one group or another. A physi- 
cian might record a person’s blood pressure, weight, and blood cholesterol level and then categorize 
that person as having a high or low probability of a heart attack. A researcher interested in retailing 
failures might be able to group firms as to whether they eventually failed or did not fail on the basis 
of independent variables such as location, financial ratios, or management changes. A bank might 
want to discriminate between potentially successful and unsuccessful sites for electronic fund trans- 
fer system machines. A human resource manager might want to distinguish between applicants to 
hire and those not to hire. The challenge is to find the discriminating variables to use in a predictive 
equation that will produce better than chance assignment of the individuals to the correct group. 

Discriminant analysis is a multivariate technique that predicts a categorical dependent vari- 
able (rather than a continuous, interval-scaled variable, as in multiple regression) based on a linear 
combination of independent variables. In each problem above, the researcher determines which 
variables explain why an observation falls into one of two or more groups. A linear combination 
of independent variables that explains group memberships is known as a discriminant function. 
Discriminant analysis is a statistical tool for determining such linear combinations. The researcher’s 
task is to derive the coefficients of the discriminant function (a straight line). 

We will consider an example of the two-group discriminant analysis problem where the 
dependent variable, Y, is measured on a nominal scale. (Although n-way discriminant analysis is 
possible, it is beyond the scope of this discussion.) Suppose a personnel manager for an electrical 
wholesaler has been keeping records on successful versus unsuccessful sales employees. The per- 
sonnel manager believes it is possible to predict whether an applicant will succeed on the basis of 
age, sales aptitude test scores, and mechanical ability scores. As stated at the outset, the problem is 
to find a linear function of the independent variables that shows large differences in group means. 
The first task is to estimate the coefficients of the applicant’s discriminant function.To calculate the 
individuals’ discriminant scores, the following linear function is used: 

Z,=6,X,, + bX, +: + bX 


ni 


Z, = ith applicant’s discriminant score 


> 
II 


discriminant coefficient for the nth variable 


ith applicant’s value on the nth independent variable 


ni 
Using scores for all the individuals in the sample, a discriminant function is determined based on 
the criterion that the groups be maximally differentiated on the set of independent variables. 
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| ja How to Get MANOVA Results 
-A department store developer gathered 
data looking at the effect of nostalgia 
on customer impressions. A field experiment was 
set up in which a key department was either given 


a modern design or a retro design. It was hoped that the retro 
design would create feelings of nostalgia. Several hundred consum- 


ers were interviewed. Since two related dependent variables are 


involved (Y, = interest and Y, = excitement), MANOVA is the appro- 


priate technique. 


ANALYZE, then GENERAL LINEAR MODEL, and then MULTIVARIATE. 


MANOVA can be conducted using SPSS by clicking on 


(If only one dependent variable were involved, the choice would 
be UNIVARIATE.) This opens a dialog box as shown here: 


sals% | %| to) al Fl ERE] Sl 
1: Centre 2 
IM m Multivariate Edo cam at at | o att | ga [git | ge | ya | pe | gtr | y= 
U es — 3 7 1 6 1 1 4 3 3 3 2 
2 A = _ Medel. | |g 1 3 T 3 1 4 4 4 4 4 3j 
3| Contrasts.. | 7 1 7 1 7 1 4 4 4 4 4 
4 a 4 5 1 5 i 4 2 2 5 1 
5 w js 5 1 5 1 5 1 3 3 3 
G 5 1 6 1 5 1 1 1 5 4 
7| 5 5 1 6 2 3 4 4 2 3 3 
a 1 7 1 7 1 4 2 2 4 3 3 
g 1 4 1 4 1 4 1 4 4 5 7 
10 8 2 5 6 6 3 4 4 3 4 3 3 
11 5 =) 1 3 1 3 4 3 4 3 1 
12 3 1 7 6 8 3 4 5 3 3 5 5 
13| | 8 1 5 2 5 2 5 5 5 4 5 
14 — z 7 2 6 2 7 2 3 3 3 3 2 
16 z 2 3 2 2 2 3 1 3 3 3 
17] a = = lel 4 i 3 1 7 7 4 3 4 4 4 3 
= SS I eae) | resp ee) ea = > ; 3 ; 3 : A > A > ; 
19 E T 7 ] a i 5 i 6 1 7 1 3 3 3 4 3 3 
20} 8 1 8 1 T af F 1 g 1 8 1 2 4 a 3 3 3 
2 5 3 1 5 1 5 1 5 1 5 1 4 3 3 3 4 
22) 1 1 i 2 1 1 2 T i i 3 3 3 3 3 3 
23| 6 2 8 1 8 1 8 7 8 1 7 1 4 2 1 4 2 2 
24| 6 1 8 3 3 2 3 7 8 1 7 2 3 4 2 5 3 1 
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Ss SPSS Processor is ready 


The dialog box includes places to enter dependent vari- 


ables, fixed factors (between-subjects categorical independent 
variables), and covariates. In this case, the fixed factors are 


1 
Ds 


Experimental variable (0 = modern, 1 = retro) 
Respondent sex (0 = male, 1 = female) 


Respondent age is included as a covariate or control variable 


(years). 


2, 


3; 


SPSS provided output that can be summarized briefly: 


Multivariate Results: 

a. Wilke’s Lambda = 0.964 

b. Overall multivariate F = 9.6 with 2 and 510 df 

c. The p-value associated with this result is less than 0.001. 
Thus the multivariate results are significant, so the 
research proceeds to interpret the individual univariate 
ANOVA results for each dependent variable (SPSS pro- 
vides these results automatically). 

The univariate model F statistics for each dependent variable 

are both significant (p < 0.001) so the researcher moves on to 

the next step. 

The individual effects associated with Y, (interest) are inter- 

preted. For example, for the experimental variable, the result is: 

a. F= 0.4, with 1 and 511 df for interest (p = 0.531). 


b. Age is not significant. 

c. The interaction is not significant. 

The individual effects associated with Y, (excitement) are inter- 
preted. For example, for the experimental variable, the result is: 


a. = 13.4, with 1 and 511 dffor excitement (p < 0.001). 
b. Sex and age are both significant predictors too 
(p < 0.001). 


c. The interaction of sex and the retro/modern experimental 
variable is also significant. 

After carefully reviewing the means for each experimental 

cell as well as the covariate results, the researcher reaches the 

following conclusions: 

a. The retro look produced more excitement but not neces- 
sarily more interest. 

b. Women are more interested and more excited about 
shopping. 

c. The effect of the retro condition was stronger for men 
than for women. That is, the difference in means between 
the retro and modern 


condition is larger for 
men than for women. 
Younger consumers 
are more excited 
about shopping. 
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Returning to the example with three independent variables, let us suppose the personnel 
manager finds the standardized weights in the equation to be 


Z=b,X, + bX, + bX, 
= 0.069X, + 0.013X, + 0.0007X, 


This means that age (X,) is much more important than sales aptitude test scores (X,). Mechanical 
ability (X,) has relatively minor discriminating power. 

In the computation of the linear discriminant function, weights are assigned to the variables to 
maximize the ratio of the difference between the means of the two groups to the standard deviation 
within groups. The standardized discriminant coefficients, or weights, provide information about 
the relative importance of each of these variables in discriminating between the two groups. 

A major goal of discriminant analysis is to perform a classification function. The purpose 
of classification in our example is to predict which applicants will be successful and which will 
be unsuccessful based on their age, sales aptitude test score, and mechanical ability, and to group 
them accordingly. To determine whether the discriminant analysis can be used as a good predic- 
tor of applicant success, current employees with known characteristics are used in constructing 
the model. Each observation (current employee) is placed into one of the groups based on the 
independent variables. Some will be classified successfully, but some will not. This information is 
provided in the “confusion matrix,” which is similar to cross-tabulations we discussed earlier. Sup- 
pose the personnel manager has 40 successful and 45 unsuccessful employees in the sample. The 
confusion matrix shows that the number of correctly classified employees (72 out of 85) is much 
higher than would be expected by chance: 


Confusion Matrix 


Predicted Group 
Actual Group Successful Unsuccessful 
Successful 34 6 40 
Unsuccessful 7 38 45 


Again, similar to cross-tabs and y’, tests can be performed to determine whether the rate of correct 
classification is statistically significant. 
Exhibit 24.5 summarizes multivariate dependence techniques. 


EXHIBIT 24.5 Multivariate Dependence Techniques Summary 


Number of Number of Type of Measurement 
Dependent Independent 


Technique Purpose Variables Variables Dependent Independent 


Multiple regression To investigate simultane- 1 2 or more Interval Interval 
ously the effects of several 
independent variables on 
a dependent variable 


Discriminant To predict the probability 1 2 or more Nominal Interval 
analysis that an object or 

individual will belong 

in one of two or more 

mutually exclusive 

categories, based on 

several independent 

variables 


MANOVA To determine simultane- 2 or more 1 or more Interval Nominal 
ously whether statisti- 
cally significant mean 
differences occur between 
groups on several 
variables 
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Analysis of Interdependence 


Suppose we wished to identify the factors that are associated with pleasant shopping experiences, '* 
identify factors that would allow better flexibility and control of logistics programs," or identify 
'© Each of these are problems that 
have been addressed through the use of a multivariate interdependence technique. Rather than 


groups of students each associated with a unique learning style. 


attempting to predict a variable or set of variables from a set of independent variables, we use 
techniques like factor analysis, cluster analysis, and multidimensional scaling to better understand the 
relationships and structure among a set of variables or objects. 


Factor Analysis 


Factor analysis is a prototypical multivariate, interdependence technique. Factor analysis is a tech- factor analysis 


nique of statistically identifying a reduced number of factors from a larger number of measured A prototypical multivariate, 
variables. The factors themselves are not measured, but instead, they are identified by forming a interdependence technique that 
statistically identifies a reduced 
number of factors from a larger 
number of measured variables. 


variate using the measured variables. Factors are usually latent constructs like attitude or satisfaction, 
or an index like social class. A researcher need not distinguish between independent and dependent 
variables to conduct factor analysis. Factor analysis can be divided into two types: 


1. Exploratory factor analysis (EFA)—performed when the researcher is uncertain about how many 
factors may exist among a set of variables. The discussion here concentrates primarily on EFA. 

2. Confirmatory factor analysis (CFA)—performed when the researcher has strong theoretical 
expectations about the factor structure (number of factors and which variables relate to each 
factor) before performing the analysis. CFA is a good tool for assessing construct validity 
because it provides a test of how well the researcher’s “theory” about the factor structure fits 
the actual observations. Many books exist on CFA alone and the reader is advised to refer to 
any of those sources for more on CFA. 


Exhibit 24.6 illustrates factor analysis graphically. Suppose a researcher is asked to examine how 
feelings of nostalgia in a restaurant influence customer loyalty. Three hundred fifty customers at 
themed restaurants around the country are interviewed and asked to respond to the following 
Likert scales (1 = Strongly Disagree to 7 = Strongly Agree): 


X,—I feel a strong connection to the past when I am in this place. 
X,—This place evokes memories of the past. 

X,—I feel a yearning to relive past experiences when I dine here. 
X,—This place looks like a page out of the past. 

X —I am willing to pay more to dine in this restaurant. 

X,—I feel very loyal to this establishment. 

X,—I would recommend this place to others. 

X,—I will go out of my way to dine here. 


Factor analysis can summarize the information in the eight variables in a smaller number 
of variables. How many dimensions, or groups of variables, are likely present in this case? 
More than one technique exists for estimating the variates that form the factors. However, 
the general idea is to mathematically produce variates that explain the greatest total variance 
among the set of variables being analyzed. In this example, the factor analysis indicates there 
are two dimensions, or factors, as shown in Exhibit 24.6. Thus, EFA provides two important 
pieces of information: 


1. How many factors exist among a set of variables? 
2. What variables are related to or “load on” which factors? 


HOW MANY FACTORS 


One of the first questions the researcher asks is,““How many factors will exist among a large num- 
ber of variables?” While a detailed discussion is beyond the scope of this text, the question is usually 
addressed based on the eigenvalues for a factor solution. Eigenvalues are a measure of how much 
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EXHIBIT 24.6 
A Simple Illustration of 
Factor Analysis 


factor loading 


Indicates how strongly a mea- 
sured variable is correlated with 
a factor. 


factor rotation 


A mathematical way of simplify- 
ing factor analysis results so as 
to better identify which variables 
“load on” which factors; the most 
common procedure is varimax. 
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Factor Loading Estimates: 


Variable: Factor 1 Factor 2 
X4 .90 —.02 
Xo 88 10 
X3 85 12 
X4 10 31 
X5 —.10 90 
Xe —.05 90 
X7 .20 75 
Xg 21 72 


variance is explained by each factor. The most common rule—and the default for most statistical 
programs—is to base the number of factors on the number of eigenvalues greater than 1.0. The 
basic thought is that a factor with an eigenvalue of 1.0 has the same total variance as one variable. 
It usually does not make sense to have factors, which are a combination of variables, that have less 
information than a single variable. So, unless some other rule is specified, the number of factors 
shown in a factor solution is based on this rule. 


FACTOR LOADINGS 


Each arrow connecting a factor (represented by an oval in Exhibit 24.6) to a variable (represented 
by a box in Exhibit 24.6) is associated with a factor loading. A factor loading indicates how strongly 
correlated a measured variable is with that factor. In other words, to what extent does a variable 
“load” on a factor? EFA depends on the loadings for proper interpretation. A latent construct can 
be interpreted based on the pattern of loadings and the content of the variables. In this way, the 
latent construct is measured indirectly by the variables. 

Loading estimates are provided by factor analysis programs. In Exhibit 24.6, the factor loading 
estimates are shown beneath the factor diagram. The thick arrows indicate high loading estimates 
and the thin dotted lines correspond to weak loading estimates. Factors are interpreted by examin- 
ing any patterns that emerge from the factor results. Here, a clear pattern emerges. The first four 
variables produce high loadings on factor 1 and the last four variables produce high loadings on 
factor 2. 

When a clear pattern of factor loadings emerges, interpretation is easy. Because the first four 
variables all have content consistent with nostalgia and the second four variables all have content 
consistent with customer loyalty, the two factors can easily be labeled. Factor one represents the 
latent construct nostalgia and factor 2 represents the latent construct customer loyalty. 


FACTOR ROTATION 


Factor rotation is a mathematical way of simplifying factor results. The most common type of factor 
rotation is a process called varimax. A discussion of the technical aspects of the concept of factor 
rotation is far beyond the scope of this book. However, factor rotation involves creating new refer- 
ence axes for a given set of variables. An initial factor solution is often difficult to interpret. Rota- 
tion “clears things up” by producing more obvious patterns of loadings. Users can observe this by 
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Getting Factor Results with 

SAS or SPSS 

Although researchers may choose to use 
a spreadsheet to produce simple or even multiple 
regression results, they will almost always turn to a 

specialized program for procedures like factor analysis. As a way 

of familiarizing readers with the mechanics involved, here are 

some instructions for getting factor results in each program. 

SAS is most typically interfaced by writing short computer 
programs. SAS can read Excel spreadsheets quite easily. The 
data simply need to be “imported” into SAS by using the File 
dialog box (click on File to begin this process—see SAS docu- 


e Click the > to move them into the “Variables” window. 
e = Click “ROTATION.” 


e Select VARIMAX. 


e Optional: Click “OPTIONS.” 


e Select “SORTED BY SIZE.” 
e Select “SUPPRESS ABSOLUTE VALUES LESS THAN.” 
= These two options make the output easier to read 

by organizing the output by the size of the loadings 
on each factor and by not showing loadings below 
some specified absolute value (0.1 by default). For 
factor analyses involving many variables, this is par- 
ticularly helpful. 


mentation contained in the help files for more on how to do ° 
this). Once the data are set up, a factor program can be easily e 
produced. Suppose we wished to run a factor program includ- 
ing a varimax rotation on eight variables labeled X1—X8. The 

program would be 


Click “CONTINUE.” 
Click “OK? 


Eie Edt View Data Transform Analyze Graphs Lilies. Add-ons Window Help 
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1 : number jo 


proc factor rotate = v; 


The results will appear in the output window. 


4.00 4.00 1.00 


var X1-X8; 


1.00 4.00 4.00 5.00 


Variables: 


€ Contidence 1 [x4] 
& Confidence 2 1X5] 


Descriptives. 
Ê Belevabilty 1 [X1] eae 


Believabilty 2 [%2] 
Ê Belevatilty 31X3] 


Extraction. 
Rotation. 
Scores. 


Confidence 3 [K6] Options. 


LP Value 1 [X7] 
Ê Vaue 28] l=] 


Selection Variable: 


4.00 4.00 6.00 
2.00 6.00 6.00 5.00 
After we click “run,” the results appear in the output a jio 500 400 50 
z 5 | 2.00 3.00 3.00 3.00 
window. 6 | 200 3.00 3.00 4.00 
. . A 7 2.00 5.00 4.00 5.00 
In SPSS, the click-through sequence is as follows: a 2a A z 
g | 2.00 2.00 2.00 4.00 rdn itro.. | 
e ANALYZE Sf in 4 sm sm | Someries 
11 1.00 5.00 5.00 4.00 P Value 4 K 
e DATA REDUCTION 12 2.00 4.00 6.00 500 Bon. 
e FACTOR ANALYSIS OE e 
Dm o 400 6:00 500 @ Price Search 3 prse 
3 i 15 2.00 4.00 3.00 §.00 Ê Price image 1 [prima. 
This produces a dialog box. Now follow the steps I | Ace a 
17 1.00 7.00 6.00 6.00 Price Image 3 (prima. 
below to get results that would match those above: o 2.00 oa ii 3o | 2 Sore Patonize ttt. 
19 2.00 6.00 4.00 4.00 a 
e Highlight variables X1 to X8 (either individually or z am po z Eo Le 
in multiples). 2 |100 4.00 400 3.00 4.00 4.00 
23 1.00 4.00 4.00 3.00 3.00 5.00 
24 1.00 9999.00 9999.00 9999.00 3.00 5.00 
25 1.00 4.00 4.00 4.00 6.00 6.00 
1.00 5.00 5.00 5.00 5.00 5.00 
2.00 5.00 6.00 6.00 6.00 6.00 


5.00 3.00 


5.00 5.00 


3.00 
3.00 
3.00 
6.00 
5.00 
6.00 
4.00 


6.00 
6.00 
7.00 
2.00 
6.00 
5.00 
7.00 


looking at the unrotated and rotated solutions in the factor analysis output. An example of how to 
run factor analysis is provided in the Research Snapshot above. 


DATA REDUCTION TECHNIQUE 


Factor analysis is considered a data reduction technique. Data reduction techniques allow a researcher 
to summarize information from many variables into a reduced set of variates or composite vari- 
ables. Data reduction is advantageous for many reasons. In general, the rule of parsimony suggests 
that an explanation involving fewer components is better than one involving more. Factor analysis 
accomplishes data reduction by capturing variance from many variables with a single variate. Data 
reduction is also a way of identifying which variables among a large set might be important in 
some analysis. Thus, data reduction simplifies decision making. 

In our example, the researcher can now form two composite factors representing the latent 
constructs nostalgia and customer loyalty. These can be formed using factor equations of this form: 


F, = LX, + LX, + LX, + LX, + LX, + LX, + LX, + LX, 


data reduction technique 


Multivariate statistical approaches 
that summarize the informa- 

tion from many variables into a 
reduced set of variates formed as 
linear combinations of measured 
variables. 


rule of parsimony 


The rule of parsimony suggests 
that an explanation involving 
fewer components is better than 
one involving more. 
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where 
F, is the factor score for the kth factor (in this case there are two factors) 
L represents factor loadings (ith) 1 through 8 for the corresponding factor 
X represents the value of the corresponding measured variable 


Using this type of equation, the scores for variables X,—X, can be summarized by two scores, 
one for factor 1 and one for factor 2. This provides an example of the rule of parsimony. If the 
researcher wanted to analyze the correlation among these variables, now all that needs to be done 
is to analyze the bivariate correlation between factor 1 (nostalgia) and factor 2 (loyalty). This should 
prove much easier than analyzing an 8 X 8 correlation matrix. Statistical programs like SPSS and 
SAS will produce factor scores automatically if requested. 

We can see that because F, is associated with high values for L, through L, (and low values for 
L., L, L,,and L) and F, is associated with high values for L, through L, (and low for L,, L,, L,, and 
L,), F, is determined almost entirely by the nostalgia items and F, is determined almost entirely 
by the customer loyalty items. The factor pattern of high and low loadings can be used to match 
measured variables to factors in this way. 


CREATING COMPOSITE SCALES WITH FACTOR RESULTS 


When a clear pattern of loadings exists as in this case, the researcher may take a simpler approach. 
F, could be created simply by summing the four variables with high loadings and creating a sum- 
mated scale representing nostalgia. F, could be created by summing the second four variables 
(those loading highly on F,) and creating a second summated variable. While not necessary, it is 
often wise to divide these summated scales by the number of items so the scale of the factor is the 


same as the original items. For example, F, would be 


(X, + X, + X, + X,)/4) 


The result provides a composite score on the 1-7 scale. The composite score approach would 
introduce very little error given the pattern of loadings. In other words, very low loadings suggest 
a variable does not contribute much to the factor. The reliability of each summated scale can be 
tested by computing a coefficient alpha estimate. Then, the researcher could conduct a bivariate 
regression analysis that would test how much nostalgia contributed to loyalty. 


COMMUNALITY 


While factor loadings show the relationship between a variable and each factor, a researcher may 
also wish to know how much a single variable has in common with all factors. Communality is 
a measure of the percentage of a variable’s variation that is explained by the factors. A relatively 
high communality indicates that a variable has much in common with the other variables taken as 
a group. A low communality means that the variable does not have a strong relationship with the 
other variables. The item might not be part of one of the common factors or might represent a 
separate dimension. Communality for any variable is equal to the sum of the squared loadings for 
that variable. The communality for X, is 


0.90? + 0.02? = 0.8104 


Communality values are shown on factor analysis printouts. 


TOTAL VARIANCE EXPLAINED 


Along with the factor loadings, the percentage of total variance of original variables explained by 
the factors can be useful. Recall that common variance is correlation squared. Thus, if each loading is 
squared and totaled, that total divided by the number of factors provides an estimate of the variance in 
a set of variables explained by a factor. This explanation of variance is much the same as R? in multiple 
regression. Again, these values are computed by the statistics program so there is seldom a need to 
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compute them manually. In this case, though, the variance accounted for among the eight variables by 
the nostalgia factor is 0.36 and the variance among the eight variables explained by the loyalty factor 
is 0.35. Thus, the two factors explain 71 percent of the variance in the eight variables: 


0.36 + 0.35 = 0.71 


In other words, the researcher has 71% of the information in two factors that are in the original 
eight items, another example of the rule of parsimony. 


Cluster Analysis 


Cluster analysis is a multivariate approach for identifying objects or individuals that are similar to 
one another in some respect. Cluster analysis classifies individuals or objects into a small number of 
mutually exclusive and exhaustive groups. Objects or individuals are assigned to groups so that there 
is great similarity within groups and much less similarity between groups. The cluster should have 
high internal (within-cluster) homogeneity and high external (between-cluster) heterogeneity. 

Cluster analysis is an important tool for the business researcher. For example, an organization 
may want to group its employees based on their insurance or retirement needs, or on job per- 
formance dimensions. Similarly, a business may wish to identify market segments by identifying 
subjects or individuals who have similar needs, lifestyles, or responses to marketing promotions. 
Clusters, or subgroups, of recreational vehicle owners may be identified on the basis of their 
similarity with respect to recreational vehicle usage and the benefits they want from recreational 
vehicles. Alternatively, the researcher might use demographic or lifestyle variables to group indi- 
viduals into clusters identified as market segments. 

We will illustrate cluster analysis with a hypothetical example relating to the types of vacations 
taken by 12 individuals. Vacation behavior is represented on two dimensions: number of vacation 
days and dollar expenditures on vacations during a given year. Exhibit 24.7 is a scatter diagram that 
represents the geometric distance between each individual in two-dimensional space. The diagram 
portrays three clear-cut clusters. The first subgroup—consisting of individuals L, H, and B—suggests a 
group of individuals who have many vacation days but do not spend much money on their vacations. 
The second cluster—represented by individuals A, I, K, G, and F—represents intermediate values 
on both variables: average amounts of vacation days and average dollar expenditures on vacations. 


Number of Vacation Days 


Dollars Spent on Vacations 
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cluster analysis 


A multivariate approach for 
grouping observations based 
on similarity among measured 
variables. 


HIBIT 24.7 
Clusters of Individuals on 
Two Dimensions 
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The third group—individuals C, J, E, and D—consists of individuals who have relatively few vaca- 
tion days but spend large amounts on vacations. 

In this example, individuals are grouped on the basis of their similarity or proximity to one 
another. The logic of cluster analysis is to group individuals or objects by their similarity to or distance 
from each other. The mathematical procedures for deriving clusters will not be dealt with here, as our 
purpose is only to introduce the technique. 

A classic study provides a very pragmatic example of the use of cluster analysis.” Managers fre- 
quently are interested in finding test-market cities that are very similar so that no extraneous varia- 
tion will cause differences between the experimental and control markets. In this study the objects 
to be clustered were cities. The characteristics of the cities, such as population, retail sales, number 
of retail outlets, and percentage of nonwhites, were used to identify the groups. Cities such as 
Omaha, Oklahoma City, Dayton, Columbus, and Fort Worth were similar and cities such as Newark, 
Cleveland, Pittsburgh, Buffalo, and Baltimore were similar, but individual cities within each group 
were dissimilar to those within other groups or clusters. (See Exhibit 24.8 for additional details.) 

This example should help to clarify the difference between factor analysis and cluster analysis. 
In factor analysis the researcher might search for constructs that underlie the variables (population, 
retail sales, number of retail outlets); in cluster analysis the researcher would seek constructs that 
underlie the objects (cities). Cluster analysis differs from multiple discriminant analysis in that the 


Cluster Analysis of Test-Market Cities 


Cluster Cluster Cluster 
Number Number Number 

1 Omaha 7 Sacramento 13 Allentown 
Oklahoma City San Bernardino Providence 
Dayton San Jose Jersey City 
Columbus Phoenix York 
Fort Worth Tucson Louisville 

2 Peoria 8 Gary 14 Paterson 
Davenport Nashville Milwaukee 
Binghamton Jacksonville Cincinnati 
Harrisburg San Antonio Miami 
Worcester Knoxville Seattle 

3 Canton 9 Indianapolis 15 San Diego 
Youngstown Kansas City Tacoma 
Toledo Dallas Norfolk 
Springfield Atlanta Charleston 
Albany Houston Fort Lauderdale 

4 Bridgeport 10 Mobile 16 New Orleans 
Rochester Shreveport Richmond 
Hartford Birmingham Tampa 
New Haven Memphis Lancaster 
Syracuse Chattanooga Minneapolis 

5 Wilmington 11 Newark iy San Francisco 
Orlando Cleveland Detroit 
Tulsa Pittsburgh Boston 
Wichita Buffalo Philadelphia 
Grand Rapids Baltimore 

6 Bakersfield 12 Albuquerque 18 Washington 
Fresno Salt Lake City St. Louis 
Flint Denver 
El Paso Charlotte 
Beaumont Portland 


Note: Points not in a cluster—Honolulu, Wilkes-Barre. 
Source: Reprinted by permission, Paul E. Green, Ronald E. Frank, and Patrick J. Robinson, “Cluster Analysis in Test-Market Selection,’ Management Science, Vol. 13, P.B393 
(Table 2), April 1967. Copyright © 1967, the Institute for Operations Research and the Management Sciences (INFORMS), 7240 Parkway Drive, Suite 310, Hanover, MD 


21076, USA. 
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groups are not predefined. The purpose of cluster analysis is to determine how many groups really 
exist and to define their composition. 


Itidim I scaling provides a means for placing objects in multidimensional space on the basis 
of e judgments of the similarity of objects. The perceptual difference among objects is 
reflected in the relative distance among objects in the multidimensional space. 

In the most common form of multidimensional scaling, subjects are asked to evaluate an 
object’s similarity to other objects. For example, a sports car study may ask respondents to rate the 
similarity of an Acura TSX to a Chevrolet Corvette, then an Acura NSX to the Corvette, followed 
by a Lotus Elise to the Corvette, a Mustang to the Corvette, and so forth. Then, the comparisons 
are rotated (i.e., Acura NSX to the TSX, Lotus Elise to the TSX, and so on until all pairs are 
exhausted). Multidimensional scaling would then generate a plot of the cars, and the analyst then 
attempts to explain the difference in objects on the basis of the plot. The interpretation of the plot 
is left to the researcher. 

In one study MBA students 
were asked to provide their 
perceptions of relative similari- 
ties among six graduate schools. 
Next, the overall similarity scores 
for all possible pairs of objects 
were aggregated for all individ- 
ual respondents and arranged in 
a matrix. With the aid of a com- 
puter program, the judgments 
about similarity were statisti- 
cally transformed into distances 
by placing the graduate schools 
into a specified multidimensional 
space. The distance between sim- 
ilar objects on the perceptual 
map was small for similar objects; 
dissimilar objects were farther 
apart. 

Exhibit 24.9 on the next page 
shows a perceptual map in two- 
dimensional space. Inspection of 
the map illustrates that Harvard 
and Stanford were perceived as 
quite similar to each other. MIT 
and Carnegie also were perceived 
as very similar. MIT and Harvard, 
on the other hand, were perceived 
as dissimilar. The researchers iden- 
tified the two axes as “quantitative 
versus qualitative curriculum” and 
“less versus more prestige.” The 
labeling of the dimension axes 
is a task of interpretation for the 
researcher and is not statistically 
determined. As with other multi- 
variate techniques in the analysis 
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A statistical technique that mea- 
sures objects in multidimensional 
space on the basis of respon- 
dents’ judgments of the similarity 
of objects. 


How similar are these cars? This 
is the input to multidimensional 
scaling. 
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The analysis stage illustrates the interdependency of the busi- 
ness research steps. How we structured the questionnaire 
and the level of data we gathered heavily influences the anal- 
ysis we can conduct. If we know the type of analysis we want 
to do, then we must construct the survey instrument around 
this analysis. 

Flow charts—such as those presented in Exhibits 24.1, 24.2, 

and 24.3—are very useful tools for a business researcher 

when determining the appropriate analytical technique. 

Multiple regression is used for two purposes. 

e To predict something based on known information. For 
example, consider a fast-food restaurant considering a 
new location. Information from current restaurants can be 
used to build a model showing the relationship between 
independent variables such as population density, traf- 
fic flow, average income, population age distributions, 
distance to competitive restaurants, and so forth. These 
factors can be regressed on the dependent variable, sales 
volume. By using the unstandardized coefficients, the bs 
from this model, we can predict sales at potential loca- 
tions under consideration. 


e To explain the drivers of something. 
Consider the fast-food example 
above. Which of these factors is most 
important in determining sales? By 
examining the standardized coefficients, 
the Bs from this model, we can directly 
compare the different independent variables. What is the 
most important driver of restaurant sales? 

e Multicollinearity can be a big problem. It can cause the 
parameter estimates to take on unreasonable and unreli- 
able values. VIFs of 5 or over are indicative of problems 
with multicollinearity. 

In a typical data matrix, with the variables as columns and 

cases as rows, we can think of factor analysis as grouping 

together the variables (columns) while cluster analysis groups 
together the respondents (rows). 

After clusters are determined, the cluster members can be 

“profiled” by examining the makeup (such as attitudes and 

demographic characteristics) of the group members. This is eas- 

ily done by using the cluster membership as the factor variable 
in ANOVA and the variables of interest in the dependent list. 


of interdependence, there are several alternative mathematical techniques for multidimensional scal- 


ing. Likewise, there are multiple ways of using multivariate procedures to generate a perceptual map. 
For example, factor scores resulting from factor analysis can be plotted along the factor dimensions. 


Such an approach may show the competitive positioning of several different firms along dimensions 


related to value and quality. 


Exhibit 24.10 summarizes the multivariate techniques for analysis of interdependence. 
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Technique Purpose Type of Measurement 


Factor analysis To summarize into a reduced number of factors the Interval 
information contained in a large number of variables 


Cluster analysis To classify individuals or objects into a small number Interval 
of mutually exclusive and exhaustive groups, ensuring 
that there will be as much likeness within groups and as 
much difference among groups as possible 


Multidimensional To measure objects in multidimensional space on the Varies depending 
scaling basis of respondents’ judgments of their similarity on technique 


Summary 


1. Understand what multivariate statistical analysis involves and know the two types of multi- 
variate analysis. Multivariate statistical methods analyze multiple variables or even multiple sets of 
variables simultaneously. They are particularly useful for identifying latent constructs using multiple 
individual measures. Multivariate techniques represent data through the use of variates. Variates are 
mathematical combinations of variables. The two major types of multivariate procedures are inter- 
dependence and dependence techniques. Interdependence techniques do not distinguish depen- 
dent and interdependent variables, whereas dependence techniques do make this distinction. 


2. Interpret results from multiple regression analysis. Multiple regression analysis predicts a con- 
tinuous dependent variable with multiple independent variables. The independent variables can 
be either continuous or categorical. Categorical variables must be coded as dummy variables. 
Multiple regression results are analyzed by examining the significance of the overall model using 
the F-test results, the individual parameter estimates, the overall model R°, and the model col- 
linearity diagnostics. Standardized regression coefficients have the advantage of a common scale, 
making them comparable from model to model and variable to variable. 


3. Interpret results from multivariate analysis of variance (MANOVA). MANOVA is an extension 
of ANOVA involving multiple related dependent variables. Thus, MANOVA represents a form of 
the GLM predicting that multiple categorical independent variables affect multiple, related depen- 
dent variables. Interpretation of a MANOVA model is similar to interpretation of a regression 
model. However, the multivariate F-test results associated with Wilke’s lambda (A) are interpreted 
first, followed by interpretation of the individual ANOVA results. 


4. Interpret basic exploratory factor analysis results. EFA is a data reduction technique in which 
the variance in multiple variables is represented by a smaller number of factors. The factors gener- 
ally represent latent factors or indexes. The pattern of loadings suggests both the number of latent 
factors that may exist and indicates which variables are associated with each factor. Rotated factor 
solutions are useful in properly interpreting factor analysis results. 


5. Know what multiple discriminant analysis can be used todo. Another dependence technique is 
discriminant analysis. Discriminant analysis uses multiple independent variables to classify obser- 
vations into one of a set of mutually exclusive categories. In other words, discriminant analysis 
predicts a categorical dependent variable with multiple independent variables. 


6. Understand how cluster analysis can identify market segments. Cluster analysis classifies mul- 
tiple observations into a smaller number of mutually exclusive and exhaustive groups. These 
should have as much similarity within groups and as much difference between groups as possible. 
In cluster analysis the groups are not predefined. However, clusters can be used to represent market 
segments because market segments also represent consumers who are similar to each other within 
a segment, but who are different from consumers in other segments. 


Key Terms and Concepts 


cluster analysis, 597 factor loading, 594 multiple regression analysis, 584 
data reduction technique, 595 factor rotation, 594 multivariate analysis of variance 
dependence techniques, 583 general linear model (GLM), 584 (MANOVA), 589 
discriminant analysis, 590 interdependence techniques, 583 partial correlation, 586 
dummy variable, 585 multicollinearity, 588 rule of parsimony, 595 


factor analysis, 593 multidimensional scaling, 599 variate, 581 
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Part 6: Data Analysis and Presentation 


Questions for Review and Critical Thinking 


Define multivariate statistical analysis. 

What is the variate in multivariate? What is an example of a 
variate in multiple regression and in factor analysis? 

What is the distinction between dependence techniques and interde- 
pendence techniques? 

What is GLM? How can multiple regression and n-way 
ANOVA be described as GLM approaches? 

What are the steps in interpreting a multiple regression analy- 
sis result? Can the same steps be used to interpret a univariate 
ANOVA model? 

A researcher dismisses a regression result because the model 

R? was under 0.70. Do you think this was necessarily wise? 
Explain. 

Return to the simple example of regression results for the toy 
company presented in the chapter. Since the data come equally 
from Europe and Canada, does this represent a potential source 
of variation that is not accounted for in the researcher’s model? 


Research Activities 


How could the researcher examine whether or not sales may be 
dependent upon country? 

What is a factor loading? 

How does factor analysis allow for data reduction? 


. How is the number of factors decided in most EFA programs? 
. What is multidimensional scaling? When might a researcher use 


this technique? 


. What is cluster analysis? When might a researcher use this 


technique? 


. Name at least two multivariate techniques that can be useful in 


constructing perceptual maps. 


. A researcher uses multiple regression to predict a client’s sales 


volume based on gross domestic product, personal income, 
disposable personal income, unemployment, and the consumer 
price index. What problems might be anticipated with this mul- 
tiple regression model? 


Use the multistep process to interpret the regression results below. This model has been run by a researcher trying to explain customer 


loyalty to a restaurant. The independent variables are customer perceptions of value, atmosphere, quality, and a location variable labeled 
center. This is a dummy variable that takes the value of 1 if the restaurant is in a shopping center and 0 if it is a stand-alone location. 


What substantive conclusions would you recommend to the restaurant company? 


Model Summary 


Std. Error 
Adjusted of the 
Model R R Square R Square Estimate 
1 0.176 0.031 0.027 0.996 
DV = Loyalty 
ANOVA(b) 
Model Sum of Squares df Mean Square F Sig. 
1 Regression 27.9731 4 6.9933 7.049 0.0000138 
Residual 876.0469 883 0.9921 
Total 904.0200 887 
Coefficients(a) 
Standardized 
Unstandardized Std. Coefficients 
Model Coefficients B Error Beta t Sig. VIF 
1 (Constant) —0.306 0.229 — 1.338 0.181 
Value 0.104 0.036 0.099 2.877 0.004 1.087 
Atmosphere 0.048 0.026 0.067 1.883 0.060 1.144 
Quality 0.044 0.028 0.054 1.590 0.112 1.038 
Center —0.250 0.071 —0.124 —3.508 0.000 1:132 
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2. Interpret the following GLM results. Following from an example in the chapter, Performance is the performance rating for a business unit 
manager. Sales is a measure of the average sales for that unit. Experience is the number of years the manager has been in the industry. The 
variable dummy has been added. This variable is 0 if the manager has no advanced college degree and a 1 if the manager has an MBA. 
Do you have any recommendations? 


The SAS System 21:06 Wednesday, April 22, 2009 
The GLM Procedure 
Dependent Variable: performance 


Sum of 
Source DF Squares Mean Square F Value Pr = F 
Model 3 173.6381430 5778793810 13.87 <.0001 
Error 36 150.2341040 4.1731696 
Corrected Total 39 323.8722470 
R-Square Coeff Var Root MSE performance Mean 
0.536132 2.514731 2.042834 81.23468 
Source DF Type III SS Mean Square F Value Pr > F 
dummy 1 136.9511200 136.9511200 32.82 <.0001 
sales 1 22.4950649 22.4950649 5339 0.0260 
Experience 1 2.2356995 2.2356995 0.54 0.4689 
Level of = ------- performance------- ----------- sales---------- ----Experience-------- 
dummy N Mean Std Dev Mean Std Dev Mean Std Dev 
0 22 79.4848842 1.78987031 15979.7723 2008.32604 23.8984087 8.27327485 
1 18 83.3733171 2.50773844 16432.0080 2015.18863 20.6788050 8.96324112 


3. Interpret the following regression results. All of the variables are the same as in number 2. These results are produced with a regression 
program instead of the GLM-univariate ANOVA program. 
a. What do you notice when the results are compared to those in number 2? Comment. 
b. List the independent variables in order from greatest to least in terms of how strong the relationship is with performance. 
c. When might one prefer to use an ANOVA program instead of a multiple regression program? 


The SAS System 21:07 Wednesday, April 22, 2009 
The REG Procedure 
Model: MODEL1 
Dependent Variable: performance 


Number of observations Read 40 
Number of observations Used 40 


Analysis of Variance 


Sum of Mean 

Source DF Squares Square F Value Pr > F 
Model 3 173.63814 57.87938 13.87 <.0001 
Error 36 150.23410 4.17317 
Corrected Total 39 323.87225 

Root MSE 2.04283 R-Square 0.5361 

Dependent Mean 81.23468 Adj R-Sq 0.4975 

Coeff Var 2.51473 


Parameter Estimates 


Parameter Standard Standardized 
Variable Label DF Estimate Error t Value Pr > |t] Estimate 
Intercept Intercept 1 72.68459 2.88092 254232 <.0001 0) 
dummy dummy I 3.80621 0.66442 5:73 <: 0001 0.66546 
Sales Sales 1 0.00038324 0.00016507 2.32 0.0260 0.26578 
Experience Experience I 0.02829 0.03866 0.73 0.4689 0.08475 
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4. Interpret the following factor analysis results. The variables represent sample results of self-reported emotions while viewing a 
film. Why are only two factors reported below? What would you name the two summated scales which could be produced based 
on these results? 


Total Variance Explained 


Extraction 
Sums of 
Initial Squared 
Eigenvalues % of Loadings % of 

Component Total Variance Cumulative % Total Variance Cumulative % 
1 2.94 36.74 36.74 2.94 36.74 36.74 
2 25) 31.34 68.08 2.51 31.34 68.08 
3 0.71 8.84 76.92 
4 0.60 7:33 84.45 
5 0.42 5.20 89.65 
6 0.29 3.67 93.32 
7 0.29 3.64 96.96 
8 0.24 3.04 100.00 


Extraction Method: Principal Component Analysis. 


Component Matrix(a) Rotated Component Matrix(a) 

Factor 1 Factor 2 Component Factor 1 Factor 2 
Interesting goga et Interesting 0.739 —0.024 
Anxious oaa osti Anxious 0.194 0.648 
Enthusiastic Gate “meee Enthusiastic 0.904 0.044 
Worried 0.295 0.828 Worried ~0.073 0.876 
Exciting 0.812 700S Exciting 0.825 0.147 
Tired 0:263 oe Tired 0.100 0.872 
Happy 0.784 “eke Happy 0.872 0.025 
Guilty 0338 0673 Guilty 0.084 0.779 


Extraction Method: Principal Component Analysis. 


Extraction Method: Principal Component Analysis. 
A 2components extracted. 


Rotation Method: Varimax with Kaiser Normalization. 
A Rotation converged in 3 iterations. 


5. ‘NET Go to http://www.census.gov and examine some of the tables for your area. Cut and paste the table into a spreadsheet or statistical 
program. Run one dependence and one interdependence technique on the data. Interpret the results. 

6. ‘NET Use http://www.ask.com to find an F-ratio calculator that will return a p-value given a calculated F-ratio and the degrees of free- 
dom associated with the test. 

7. ‘NET The Federal Reserve Bank of St. Louis maintains a database called FRED (Federal Reserve Economic Data). Navigate to the 
FRED database at http://www.stls.frb.org/fred/index.html. Use the consumer price index, exchange rates, interest rates, and one other 
variable to predict the consumer price index for the same time period. The data can either be downloaded or cut and pasted into 
another file. 
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Case 24.1 The Utah Jazz 


The Utah Jazz are interested in understanding the 
market for the National Basketball Association. 
A study is conducted as described here. 


Data Collection 
4 Data came from a survey of adult residents of a large 


© GETTY IMAGES/ 
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western metropolitan area. Respondents were selected in accordance 
with a quota sample of the area that was based on the age and sex 
characteristics reported in the most recent census. Six age categories 
for both males and females were used to gain representation of these 
characteristics in the market. In addition, interviewers were assigned to 
various geographic regions to ensure representation of the market with 
respect to socioeconomic characteristics. A total of 225 respondents age 
18 and over provided data for the study. 

Interviews were conducted by trained interviewers using a self- 
completion questionnaire. The presence of the interviewers served 
to answer any questions that might arise as well as to ensure compli- 
ance with the instructions. 

Measures for the variables in the three categories of AIO (atti- 
tudes, interest, and opinions) were obtained using six-point rating 


Characteristics of the Market for Professional 


None 


scales. For example, the item for price proneness asked, “When 
you are buying a product such as food, clothing, and personal care 
items, how important is it to get the lowest price?” This item was 
anchored with “Not at all important” and “Extremely important.” 
The broadly defined category of demographics included standard 
socioeconomic characteristics as well as media preferences and atten- 
dance at professional hockey matches and university basketball games. 
Demographics were obtained using a variety of forced-choice and 
free-response measures, the natures of which are indicated in the vari- 
able information presented in Case Exhibit 24.1—1. The categorical 
measures of type of dwelling and preferred type of radio programming 
were coded as dummy variables for analysis. The criterion measure of 
patronage came from an open-ended question asking how many NBA 
games the respondent had attended during the past season. 


Data Analysis 

The distribution of responses to the attendance item was skewed, as 
might be expected. Thus, 57.3 percent of the respondents reported 
having attended none of the 41 possible games. Those who attended 
at least one game were recorded in accordance with specification 


Basketball 


Low High Loading 
Variables (n = 129) (n = 47) (n = 49) F-Ratio II 


Market Orientation? 


Price proneness 3:99 4.04 3.63 1.31 27 
Quality proneness 4.95 4.74 4.82 .74 .480 
Product awareness 4.45 4.02 4.00 3.71 026 
Product involvement 4.34 4.43 4.14 66 S17 
Prepurchase planning 4.21 3.85 3.82 2.03 134 
Brand loyalty 3,95 4.39 3.92 .96 384 
Information search 3.83 355 3.96 1.06 .347 
Interests in Leisure Pursuits” 
Need for change from work routine 4.11 4.34 4.55 1.92 150 34 
Need for independence in leisure 
choice 4.88 4.94 4.96 09 19 .08 
Need for companionship during 
leisure 4.85 HS) 4.88 1.16 317 10 
Preference for passive versus active 
pursuits 3.64 4.15 4.57 7.28 .001 70 
Self-image as athletic 3.67 4.38 4.47 5.89 .003 60 
Childhood attendance at sporting 
events 3.38 3.89 4.18 5.41 005 .60 
Pleasure from sporting events 3.14 3.66 4.27 10.62 .000 84 
Opinions about Professional Sports‘ 
Athletes as a reference group 3.51 3.64 4.18 3.90 022 30 E) 
Excitement from enthusiastic crowd 4.27 4.72 4.73 2.70 069 .24 .20 
Excitement from animosity 
between teams 3.29 3.28 4.27 6.94 .001 36 —Al 
Acceptance of alcoholic beverages 
at games 2.60 3.64 3.39 6.88 .001 34 46 
Enjoyment from large crowds 3.91 3.85 4.49 3.22 042 23 T2 
Enjoyment when standing at games BB 3.44 3.90 2.25 108 22 =al 
Excitement of professional 
basketball 4.09 391 4.67 5.34 .005 27 —.49 
Satisfaction from professional 
basketball 397 3.70 4.80 24.98 .000 78 =26. 
Importance of a winning team 4.26 4.69 5.07 6.12 .003 39 02 
Demographics? 
Years in local area (number of years) 24.47 23.51 19.04 2.02 35 -.24 
Sex (0 = female, 1 = male) 40 55 65 5.45 .006 .39 


(Continued) 
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-1 Characteristics of the Market for Professional Basketball (Continued) 


None 


Variables (n = 129) 


Demographics“ 


Low 


(n = 47) 


High 
(n = 49) 


Loading 
F-Ratio II 


Marital status (0 = single, 1 = married) .60 62 45 2.00 138 Sail 
Household size (number of persons) 313 2.27 3.14 11 896 01 
Rents apartment (0 = no, 1 = yes) 18 32 35 3.70 .026 30 
Rents a house (0/1) .09 09 08 03 .967 =03 
Owns a house (0/1) .60 .49 Al 3.08 048 =29 
Owns a condominium (0/1) 05 02 06 50 607 01 
Head of household (0/1) 52 .64 67 2.19 15 .24 
Occupational prestige of self 

(NORC scale) 68.05 69.36 70.63 127 284 19 
Job leaves evenings free for 

entertainment (0/1) 87 85 92 57 567 10 
Prefers easy-listening music radio 

programming (0/1) 39 .34 29 .83 .438 S15 
Prefers contemporary popular 

music radio (0/1) 16 28 27 1.96 143 20 
Prefers rock music radio (0/1) 14 11 27 2.76 066 23 
Prefers country-western music 

radio (0/1) 15 19 .08 122 .299 alles 
Prefers talk and news radio 

programming (0/1) 09 04 .06 52 597 —.08 
Education (years of schooling) 13.08 13.66 13.56 5.11 .007 38 
Age (years) 41.51 39.79 33.59 4.21 .016 —.34 
Annual household income 

(7-point scale) 4.88 51 5.16 65 523 13 
Monthly personal expenditures on 

entertainment for household 

(dollars) 85.10 112.45 101.29 1.38 254 13 
Attendance at university basketball 

(games last year) .92 1.89 4.14 15.29 .000 66 
Attendance at professional hockey 

(matches last year) 69 2.28 2.78 5.33 .006 B7 


aCanonical discriminant analysis not significant at p = .189; therefore, no loadings are given. 


ÞCanonical discriminant analysis significant at p = .004, first function significant. Centroids for the market segment groups are as follows: none, —.29; low, .19; high, .59. 
‘Canonical discriminant analysis significant at p = .000, both functions significant. Centroids for the market segment groups on the first function are as follows: none, 
-.47; low, .26; high, 1.00. Centroids on the second function are as follows: none, -.10; low, .57; high, -.27. 

‘Canonical discriminant analysis significant at p = .004, first function significant. Centroids for the market segment groups are as follows: none, -.41; low, .14; high, .97. 


of the light half and the heavy half of the market. This category of 
patrons was split as nearly as possible at the median, giving 20.9 per- 
cent who attended one or two games and 21.8 percent who attended three 
or more. The three patronage categories thus used for analysis were 
subsequently termed the none, low, and high attendance segments. 

Given the categorical nature of the criterion measure and the 
continuous nature of the predictor variables, both univariate analysis 
of variance and discriminant analysis were employed for the survey. 
Each of the four categories of predictor variables was subjected to 
a separate discriminant analysis to test the multivariate hypothesis of 
relationship between patronage and the predictor set in question. 
The univariate ANOVAs were used to provide complementary 
information about the nature of the segments. 


Results 
Case Exhibit 24.1—1 gives the results of the analyses conducted on 
the four sets of predictor variables. Each set produced at least one 
variable that was significant in univariate analysis. Three of the four 
discriminant analyses were significant. 

The first predictor set involving AIOs, “marketing orientation,” 
provided only a single variable that ANOVA showed to differentiate 


among the members of the three patronage segments. The discrimi- 
nant analysis was nonsignificant. 
“Interests in leisure pursuits” emerged as more predictive. By 
univariate ANOVA, four variables were found significant at the 
0.05 level. The discriminant analysis was significant at p = 0.004. 
“Opinions about professional sports” provided significant pre- 
diction of patronage. Seven of the nine variables reached significance 
at the 0.05 level in univariate analysis. The discriminant analysis 
was significant beyond p = 0.001, and it produced two significant 
functions. The first significant function provided 79.8 percent of the 
explained variance, and the second function provided 20.2 percent. 
Finally, the set “demographics” was also found to be related to 
patronage. Counting the four dummy-coded measures of dwelling 
type and the five similar preferences for radio programming as sepa- 
rate variables, 7 of the 22 demographics reached significance in uni- 
variate analysis. The discriminant analysis was significant at p = 0.004. 


Question 
Interpret the managerial significance of the ANOVA and multiple 
discriminant analysis results. 


Source: Courtesy of the American Marketing Association. Adapted from paper presented at AMA conference, 1984. 
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Case 24.2 How Do We Keep Them? 


© GETTY IMAGES/ 


Download the data sets for this case from http://www. 
thomsonedu.com/marketing/zikmund or request them 
from your instructor. 

Use the data labeled profit for this case. The 
- data go along with The Research Snapshot on 
d page 587. In addition, management has collected 
several semantic differential scales from the managers asking them 
to use emotions to describe the way they feel about their jobs. The 
emotions include 
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involved exciting fun satisfied happy pleased 


The managers want to understand turnover. So, another variable is 
included that gives the likelihood a manger will quit within 


12 months (labeled turnover in data). After running some initial 
regression models with eight independent variables predicting 
turnover, management was confused. They complained that there 
were too many variables to make sense of. 

Thus, the researcher turned to a data reduction technique. 
Afterwards, a regression model with fewer independent variables 
gave some clear direction regarding emotions and turnover: 

1. Perform the appropriate multivariate technique to identify 
underlying dimensions that may exist among the emotion 
ratings. 

2. Create scales for any underlying dimensions. 


g 


Use these scales as independent variables in a regression model. 
4. Interpret the results. 


CHAPTER 25 
COMMUNICATING 
RESEARCH 
RESULTS: 


REPORT 
GENERATION, ORAL 


After studying this chapter, you should be able to 
1. Discuss the research report from the perspective of the 


communications process 
2. Define the parts of a research report following a standard 


3. Explain how to use tables for presenting numerical 


P R E S E NTATI O N I information 


4. Summarize how to select and use the types of research 


AND FOLLOW-UP ie 
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5. Describe how to give an effective oral presentation 
6. Discuss the importance of Internet reporting and research 


follow-up 


Chapter Vignette: A Business Report Title 
(and Nothing Else)—Tips to Get Started 


A significant part of this text has been devoted to the development and execution of business 
research, but perhaps the most important component of the business research process has yet 
to be discussed. Regardless of the research topic or audience, you as a business researcher are 
faced with communicating your efforts to appropriate stakeholders. This is not a straightforward 


task for many researchers, who often find themselves staring at a blank computer screen, with a 
title on the page, and nothing else. To help you get 


started, you should reflect on a few critical questions 
regarding your efforts. Fortunately, Tim North of Better 
Writing Skills (http://www.betterwritingskills.com) provides 
some tips to help you frame this important aspect of 
your research." 

First, you must understand who the readers are, and 
focus your writing on those stakeholders who are most 
likely to need your results. It is difficult to satisfy everyone's 
needs, so identifying the key readers of your business 
research is a must. Second, you must ask yourself why the 

readers want your results. Is it for evaluation purposes, to 
make decisions, or simply for information? Third, as you write 
your report you should understand what your stakehold- 
ers expect, and how much they already understand about 
the project or program you are writing about. Rehashing 
what is already known or commenting on results that are not 
specifically needed will only reduce your report's impact. 


Taking what for some stakeholders is a complicated and statistics-heavy set of business 
research results and translating them into a useful and clearly written research report is not 
always easy. It takes practice, and at times guidance and mentorship from more experienced col- 
leagues. Nonetheless, it is a crucial step in the business research process. Your elegant research 
results are meaningless if you cannot communicate them effectively. Taking advantage of Tim 


North's guides to better writing may be the first step toward completing this journey. 


Chapter 25: Communicating Research Results: Report Generation, Oral Presentation, and Follow-Up 


Introduction 


Why should a careful researcher have to be a good writer, too? After the researcher has spent days, 
weeks, or even months working on a project, preparation of the report may feel like an anticli- 
mactic formality. All the “real” work has been done; it just has to be put on paper. This attitude 
can be disastrous, however. Even if the project was well designed, the data carefully obtained and 
analyzed by sophisticated statistical methods, and important conclusions reached, unless the report- 
ing is effective all of the earlier efforts will have been wasted. Often the research report is the only 
part of the project that others ever see. If people who need to use the research results have to 
wade through a disorganized presentation, are confused by technical jargon, or find sloppiness of 
language or thought, they will probably discount the report and make decisions without it, just as 
if the project had never been done. The research report is a crucial means for communicating the 
whole project. This chapter explains the communication of research results with written reports, 
oral presentations, and follow-up conversations.” 


Insights from the Communications Model 


Some insights from the theory of communications help to clarify the importance of the research 
report. Exhibit 25.1 illustrates one view of the communication process. Several elements influence 
successful communication. 


e The communicator—the source or sender of the message (the writer of the report) 

e The message—the set of meanings being sent to or received by the audience (the findings of the 
research project) 

e The medium—the way in which the message is delivered to the audience (the oral or written 
report itself) 

e The audience—the receiver or destination of the message (the manager who will make a deci- 
sion based—we hope—on the report findings) 

e  Feedback—a communication, also involving a message and channel, that flows in the reverse 
direction (from the audience to the original communicator) and that may be used to modify 
subsequent communications (the manager’s response to the report) 


This model may make communication seem simple. Perhaps communication is simple when 
the message flows smoothly from writer to reader, and then in return, from reader to writer to pro- 
vide feedback. Actually, communication is more complex. Exhibit 25.2 on the next page illustrates 
one key difficulty. The communicator and the audience each have individual fields of experience. 
These overlap to some extent; otherwise no communication would be possible. Still, a great deal 
of experience is not common to both parties. As communicators send a message, they encode it 


Who Says What In What Way To Whom 


2. Message 
1. Communicator |————————__» = 


With What Effect 


5. Feedback 


Message 
Original < < 
communicator 
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>a luxury to be 
i 


1 
piaarl OV eEAATT 
understood. 


—Ralph Waldo Emerson 


communication process 


The process by which one person 
or source sends a message to an 
audience or receiver and then 
receives feedback about the 
message. 


; BIT 25.1 
The Communication Process 


COURTESY OF QUALTRICS.COM 


The development of a research report starts with building a environment and experiences of students who 
good research question. Imagine that your supervisor assigns may be potential employees of a firm. 
you the task of developing a report that comments on the work 


1. Design an appropriate research question to 

answer this request. 

2. Using Survey This! items, develop and 
conduct an analysis that addresses your research 
question. 

3. Build appropriate tables and visual aids to support 
your findings and conclusions. 

4. Draft a business research report that is at least five 
pages long. 

5. Develop and present a PowerPoint presentation of 
your results. 


EXHIBIT 25.2 
Communication Occurs ina 
Common Field of Experience 
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Field of Experience Field of Experience 


—— 


Communication 


in terms that make sense to them based on their fields of experience. As the individuals in the 
audience receive the message, they decode it based on their own fields of experience. The message 
is successfully communicated only if the parties share enough common experience for it to be 
encoded, transmitted, and decoded with roughly the same meaning. 

In the research setting, the communicator (the researcher) has spent a great deal of time study- 
ing a problem. He or she has looked at secondary sources, gathered primary data, used statistical 
techniques to analyze the data, and reached conclusions. When the report on the project is written, 
all this “baggage” will affect its contents. On the assumption that the reader has a lot of background 
information on the project, the researcher may produce pages and pages of unexplained tables, 
expecting the reader to unearth from them the same patterns that the researcher has observed. The 
report may contain technical terms such as parameter estimate, F-distribution, statistical significance, cor- 
relations, and eigenvalue on the assumption that the reader will understand them. Another researcher 
may assume that the reader does not have a lot of background information and may go overboard 
explaining everything in the report in sixth-grade terms. Although the researcher’s intent is to 
ensure that the reader will not get lost, this effort may insult the reader. 

Usually when readers receive a report, they have not thought much about the project. They 
may not know anything about statistics and may have many other responsibilities. If they cannot 
understand the report quickly, they may put it on a stack of things to do someday. 

Simply delivering a report to its audience is not sufficient to ensure that it gets attention. The 
report needs to be written so as to draw on the common experience of the researcher and the 
reader. And the person responsible for making sure that it does so is the writer—not the reader. 
Unless a report is really crucial, a busy reader will not spend time and effort struggling through an 
inadequate or difficult-to-read document. 
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The Report in Context 


A research report is an oral presentation and/or written statement whose purpose is to communi- 
cate research results, strategic recommendations, and/or other conclusions to management or other 
specific audiences. Although this chapter deals primarily with the final written report required by an 
extensive research project, remember that the final report may not be the only kind prepared. For a 
small project, a short oral or written report on the results may be all that is needed. Extensive proj- 
ects may involve many written documents, interim reports, a long final written report, and several 
oral presentations. In addition, technical materials may be posted on an organization’s intranet. 

The chapter’s emphasis on the final report should not be taken to mean that other communi- 
cations, such as progress reports during the course of the project, are any less important to the proj- 
ect’s eventual success. The chapter’s suggestions can be easily adapted to apply to these additional 
communications and shorter, less formal reports. 


Report Format 


Although every research report is custom-made for the project it represents, some conventions 
of report format are universal. They represent a consensus about the parts necessary for a good 
research report and how they should be ordered. This consensus is not a law, however. Every book 
on report writing suggests the use of its own unique format, and every report writer has to pick 
and choose the section and order that will work best for the project at hand. Many companies and 
universities also have in-house report formats or writing guides for writers to follow. The format 
described in this section serves as a starting point from which writers can shape their own appro- 
priate format. It includes seven major elements: 


Title page (sometimes preceded by a title fly page) 
Letter of transmittal 

Letter of authorization 

Table of contents (and lists of figures and tables) 


2 ak 


Executive summary 
a. Objectives 
b. Results 
c. Conclusions 
d. Recommendations 
6. Body 
a. Introduction 
1. Background 
2. Objectives 
b. Methodology 
c. Results 
d. Limitations 
e. Conclusions and recommendations 
7. Appendix 
a. Data collection forms 
Detailed calculations 
General tables 
Bibliography 


eno Ss 


Other support material 


This format is illustrated graphically in Exhibit 25.3 on the next page. 


Tailoring the Format to the Project 


The format of a research report may need to be adjusted for two reasons: (1) to obtain the proper 
level of formality and (2) to decrease the complexity of the report. The format given here is for the 
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research report 


An oral presentation or written 
statement of research results, 
strategic recommendations, and/ 
or other conclusions to a specific 
audience. 


report format 


The makeup or arrangement 
of parts necessary to a good 
research report. 
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EXHIBIT 25.3 Report Format 


v v 


Results Data collection 
forms 


Area 1 ; 
Conclusions and 


recommendations Detailed 
Area 2 calculations 


Final area 


most formal type of report, such as one for a large project done within an organization or one done 
by a research agency for a client company. This type of report is usually bound in a permanent 
cover and may be hundreds of pages long. 

In less formal reports, each part is shorter, and some parts are omitted. Exhibit 25.4 illustrates 
how the format is adapted to shorter, less formal reports. The situation may be compared to the 
way people’s clothing varies according to the formality of the occasion. The most formal report is 
dressed, so to speak, in a tuxedo or long evening gown. It includes the full assortment of prefatory 
parts—title fly page, title page, letters of transmittal and authorization, and table of contents. Like 
changing into an everyday business suit, dropping down to the next level of formality involves 
eliminating parts of the prefatory material that are not needed in this situation and reducing the 


EXHIBIT 25.4 Adapting Report Format to Required Formality 


-= Report body Summary 
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complexity of the report body. In general, as the report moves down through the sport coat and 
slacks and then blue jeans stages, more prefatory parts are dropped, and the complexity and length 
of the report body are reduced. 

How does the researcher decide on the appropriate level of formality? The general rule is to 
include all the parts needed for effective communication in the particular circumstances—and no 
more. This depends on how far up in management the report is expected to go and how routine 
the matter is. A researcher’s immediate supervisor does not need a 100-page, “black-tie” report on 
a routine project. However, the board of directors does not want a one-page “blue jeans” report on 
a big project that backs a major expansion program. The formal report to top management may 
later be stripped of some of the prefatory parts (and thus reduced in formality) for wider circula- 
tion within the company. 


The Parts of the Report 


The guidelines that call for each element of the research report also dictate the content of each part. 


TITLE PAGE 


The title page should state the title of the report, for whom the report was prepared, by whom it 
was prepared, and the date of release or presentation. The title should give a brief but complete 
indication of the purpose of the research project. Addresses and titles of the preparer and recipient 
may also be included. On confidential reports, the title page may list the people to whom the 
report should be circulated. For the most formal reports, the title page is preceded by a title fly 
page, which contains only the report’s title. 


LETTER OF TRANSMITTAL 


Relatively formal and very formal reports include a letter of transmittal. Its purpose is to release or deliver 
the report to the recipient. It also serves to establish some rapport between the reader and the writer. 
This is the one part of the formal report in which a personal or even slightly informal tone should be 
used. The transmittal should not dive into the report findings except in the broadest terms. 

Exhibit 25.5 on the next page presents a sample letter of transmittal. Note that the opening 
paragraph releases the report and briefly identifies the factors of authorization. The letter comments 
generally on findings and matters of interest regarding the research. The closing section expresses the 
writer’s personal interest in the project just completed and in doing additional, related work. 


LETTER OF AUTHORIZATION 


The letter of authorization is a letter to the researcher that approves the project, details who has 
responsibility for it, and describes the resources available to support it. Because the researcher 
would not write this letter personally, writing guidelines will not be discussed here. In many situa- 
tions, simply referring to the authorization in the letter of transmittal is sufficient. If so, the letter of 
authorization need not be included in the report. In some cases, though, the reader may be unfa- 
miliar with the authorization or may need detailed information about it. In such cases, the report 
should include this letter, preferably an exact copy of the original. 


THE TABLE OF CONTENTS 


A table of contents is essential to any report more than a few pages long. It should list the divisions 
and subdivisions of the report with page references. The table of contents is based on the final 
outline of the report, but it should include only the first-level subdivisions. For short reports it is 
sufficient to include only the main divisions. If the report includes many figures or tables, a list of 
these should immediately follow the table of contents. 
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Example Transmittal Letter 
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EMR ResearchGroup 


Moving you forward! 


August 30, 2009 


Mr. Mario Lagasto 
President, Leading Edge Food Group 
Columbia, IA 50057 


Re: Presentation of Research Identifying Customer Loyalty 
Dear Mr. Lagasto: 


The report outlined in the research proposal of March 15, 2009, is complete. | have 
personally supervised the project, conducted the statistical analyses, and prepared this 
report along with my two senior research associates, Natalia James and David Parker. 


The report addresses the key decision statement: In what ways can your restaurants build 
customer loyalty so that revenues increase through more frequent patronage? The key 
research questions involve identifying controllable characteristics that end up relating to 
greater share of wallet. As agreed upon in the proposal, the report offers no specific 
recommendations for managerial action, but rather, it presents conclusions which should 
enable you to make informed decisions. Thus, the conclusions conform to the 
deliverables described in the proposal letter. 


We successfully accomplished the research project as described in the outline. We were 
able to meet our goals for interviewing groups of customers and non-customers in a 
timely fashion. We are grateful for your business and look forward to working with you 
as you develop strategic plans of action based on this report. Once you have taken a look 
at the report, please contact me and we will schedule a formal presentation and 

question and answer period for your management team. 


Sincerely, 


Barry J. Babin 
President 


EMR Research Group 
114 Railroad Ave 
Choudrant, LA 71272 


THE SUMMARY 


The summary, also known as executive summary, briefly explains why the research project was 
conducted, what aspects of the problem were considered, what the outcome was, and what should 
be done. It is a vital part of the report. Studies have indicated that nearly all managers read a 
report’s summary, while only a minority read the rest of the report. Thus, the writer’s only chance 
to produce an impact may be in the summary. 
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4A Research ROI Lesh International proposes measures that put a dollar 


= ~The research summary, like the original value on the research. One of these, which the firm calls ROI 
research design, should be based on the Lite, is the dollar value of the decision multiplied by the client's 
business problem to be solved and the resulting estimate of the increased confidence that the right alternative 
insight into how to address that problem. In today’s will be selected, divided by the cost of the research. The second 
competitive business environment, companies cannot afford to measure, ROI Complete, incorporates the likelihood that the 
do research just because it is interesting. They need research that research client will act on the 
helps them compete as an organization. information. 
Logically, this should mean that companies are measuring 
À 4 A Sources: Based on Maddox, Kate, 
whether research helps their bottom line. In practice, however, “Market Research Charges Online” 
measuring the return on investment (ROI) for research is still B to B (April 4, 2005); Maddox, Kate, 
a relatively new idea. Research consultants at a firm called A. A Rise coe acd See 
Dawn Lesh International surveyed companies to find out how “Market Research Charges Online,” 
they measure the effectiveness of their research projects. The B to B, 90 (April 4, 2005), 28-31; 


Hieggelke, Brent, “Marketing & ROI,’ 


firm discovered that only 1 0 to 15 percent of the companies iMediaConnection, (October 19, 2004), 
measured research effectiveness at all. Some of those that did http://www.imediaconnection.com, 
measure it simply looked at whether the project's client was accessed April 1; 2006. 


satisfied or whether the quality of the work was high. In other 
cases, researchers determined the expected value of each idea 
uncovered by the research project. 


The summary should be written only after the rest of the report has been completed. It rep- 
resents the essence of the report. It should be one page long (or, at most, two pages), so the writer 
must carefully sort out what is important enough to be included in it. Several pages of the full 
report may have to be condensed into one summarizing sentence. Some parts of the report may be 
condensed more than others; the number of words in the summary need not be in proportion to 
the length of the section being discussed. The summary should be written to be self-sufficient. In 
fact, the summary is often detached from the report and circulated by itself. 

The summary contains four elements. First, it states the objectives of the report, including 
the most important background information and the specific purposes of the project. Second, it 
presents the methodology and the major results. Finally, the conclusions of the report are presented. 
These are opinions based on the results and constitute an interpretation of the results. Finally come 
recommendations, or suggestions for action, based on the conclusions. In many cases, managers 
prefer not to have recommendations included in the report or summary. Whether or not recom- 
mendations are to be included should be clear from the particular context of the report. 

An additional element that can be included in the summary is a short justification for the 
research study and report itself. As seen in the Research Snapshot above, the use of ROI to measure 
research effectiveness is a new way that business researchers are providing this justification. 


THE BODY 


The body constitutes the bulk of the report. It begins with an introduction section setting out the 
background factors that made the project necessary as well as the objectives of the report. It con- 
tinues with discussions of the methodology, results, and limitations of the study and finishes with 
conclusions and recommendations based on the results. 

The introduction explains why the project was done and what it aimed to discover. It should 
include the basic authorization and submittal data. The relevant background comes next. Back- 
ground information is important, and may require that you gather additional external data as 
discussed in the Research Snapshot on page 616. Enough background should be included to 
explain why the project was worth doing, but unessential historical factors should be omitted. The 
question of how much is enough should be answered by referring to the needs of the audience. 
A government report that will be widely circulated requires more background than a company’s 


introduction section 


The part of the body of a 
research report that discusses 
background information and 
the specific objectives of the 
research. 
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How Do We Stack Up? The Value of Business.gov if you look in the right place. One place to 
Many business research projects are designed to capture informa- look is Business.gov (http://www.business.gov), 
tion on attitudes and behaviors that are reflective of the company. the clearinghouse Web site that captures 
The bigger question to your research stakeholders may be, “How governmental and economic statistics from 
do we stack up with other similar firms?” When writing a research agencies across the United States. 


report, it often helps to provide some kind of context, whether it Business.gov includes statistics on employ- 
is comparative data from other firms, or general information that ment, consumer spending, production, trade, and other firm-level 
the report reader can use to get the big picture. Obviously, you or industry-level data that may be useful to you as you frame your 
Busi - can't always research results. For example, if your research report is focused on 
SS omnes gat | get the exact turnover trends in your firm, you may be able to capture industry- 
A same data wide employment trends to compare your results to the larger A 
from other picture within an industry or geographic location. E 
similar firms. The value of Business.gov is the potential to compare how z 
Z But you may your firm is doing to the “big picture.’ While it may not have ; 
z be able to results for every research project or report, it is worth searching #4 
8 get at least through as you develop the body of your report. 8 
3 some level 5 
3 of context, Source: Business.gov, http://www.business.gov, downloaded April 28, 2009. © 


internal report on customer satisfaction. The last part of the introduction explains exactly what the 
project tried to discover. It discusses the statement of the problem and research questions as they 
were stated in the research proposal. Each purpose presented here should have a corresponding 
entry in the results section later in the report. 
research methodology The second part of the body is the research methodology section. This part is a challenge to 
section write because it must explain technical procedures in a manner appropriate for the audience. The 


The part of the body of a report material in this section may be supplemented with more detailed explanations in the appendix or 


that presents the findings of the 4 glossary of technical terms. This part of the report should address four topics: 
project. It includes tables, charts, 


and an organized narrative. 1. Research design. Was the study exploratory, descriptive, or causal? Did the data come from pri- 
mary or secondary sources? Were results collected by survey, observation, or experiment? A copy 
of the survey questionnaire or observation form should be included in the appendix. Why was 
this particular design suited to the study? 

2. Sample design. What was the target population? What sampling frame was used? What sample 
units were used? How were they selected? How large was the sample? What was the re- 
sponse rate? Detailed computations to support these explanations should be saved for 
the appendix. 

3. Data collection and fieldwork. How many and what types of fieldworkers were used? What training 
and supervision did they receive? Was the work verified? This section is important for establishing 
the degree of accuracy of the results. 

4. Analysis. This section should outline the general statistical methods used in the study, but the 
information presented here should not overlap with what is presented in the results section. 


results section The results section should make up the bulk of the report and should present, in some logical 


The part of the body ofareport order, those findings of the project that bear on the objectives. The results should be organized as 
that presents the findings of the a continuous narrative, designed to be convincing but not to oversell the project. Summary tables 
project. It includes tables, charts, and charts should be used to aid the discussion. These may serve as points of reference to the data 

ang aiorganizeditiarrative: being discussed and free the prose from excessive facts and figures. Comprehensive or detailed 
charts, however, should be saved for the appendix. 

Because no research is perfect, its limitations should be indicated. If problems arose with 
nonresponse error or sampling procedures, these should be discussed. However, the discussion of 
limitations should avoid overemphasizing the weaknesses; its aim should be to provide a realistic 


basis for assessing the results. 
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The last part of the body is the conclusions and recommendations section. As mentioned earlier, 
conclusions are opinions based on the results, and recommendations are suggestions for action. The 
conclusions and recommendations should be presented in this section in more detail than in the 
summary, and the text should include justification as needed. 


THE APPENDIX 


The appendix presents the “too ...” material. Any material that is too technical or too detailed 
to go in the body should appear in the appendix. This includes materials of interest only to some 
readers or subsidiary materials not directly related to the objectives. Some examples of appendix 
materials are data collection forms, detailed calculations, discussions of highly technical questions, 
detailed or comprehensive tables of results, and a bibliography (if appropriate). Since the advent of 
company intranets, much appendix material is posted on internal Web pages. 


BASIC BUSINESS RESEARCH REPORT 


The outline described applies especially to applied business research projects. When basic research 
reports are written, such as might be submitted and potentially published in an academic business 
journal, the outline changes slightly since some components become irrelevant.A common outline 
used in basic business research proceeds as follows: 


1. Abstract 
. Introduction 
3. Background 
a. Literature Review 
b. Hypotheses 
4. Research Methods 
5. Results 
6. Discussion 
a. Implications 
b. Limitations 
c. Future Research 
7. Conclusions 
8. References 
9. Appendices 


The material in the sections does not change very much between different business research 
problems. So the elements within each section are the same with only the noted exceptions. The 
basic research report will place a greater emphasis on how the current research is integrated into 
the previous literature dealing with the research topic. This section finishes with a specific set of 
theoretical hypotheses. The research methodology and results section may contain more statistical 
detail and jargon since the reader is expected to be knowledgeable in basic research methodology. 
A quick look at an academic business journal like the Journal of Business Research, the Journal of 
Marketing, the Journal of Finance, or the Journal of Management will give a reader a feel for this type of 
writing. Overall, though, both basic and applied business research reports involve technical writing 
and the principles of good technical writing apply. 


Effective Use of Graphic Aids 


Used properly, graphic aids can clarify complex points or emphasize a message. Used improperly 
or sloppily, they can distract or even mislead a reader. Graphic aids aids work best when they are 
an integral part of the text. The graphics should always be interpreted in the text. This does not 
mean that the writer should exhaustively explain an obvious chart or table, but it does mean that 
the text should point out the key elements of any graphic aid and relate them to the discussion 
in progress. 
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conclusions and 
recommendations section 


The part of the body of a report 
that provides opinions based on 
the results and suggestions for 
action. 


graphic aids 


Pictures or diagrams used to 
clarify complex points or empha- 
size a message. 


Stubheads 


Footnote 
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Several types of graphic aids may be useful in research reports including tables, charts, maps, 


and diagrams. The following discussion briefly covers the most common ones, tables and charts. 
The reader interested in other types of graphic material should consult more specialized sources. 


SS 


Tables 


Tables are most useful for presenting numerical information, especially when several pieces of 
information have been gathered about each item discussed. For example, consider how hard it 
might be to follow the information in Exhibit 25.6 with only narrative text and no graphical aids. 
Using tables allows a writer to point out significant features without getting bogged down in detail. 
The body of the report should include only relatively short summary tables, with comprehensive 
tables reserved for an appendix. 


Title 
Table 1024. Retail Sales—New Passenger Cars: 1990 to 2003 


[In thousands 9,300 represents 9,300,000, except as indicated. Retail new car sales include both sales to individuals and to corporate fleets. It 


also includes leased cars.] 


Total retail new passenger 


car sales 
Domestic’ 
Imports 
Japan 
Germany 


Other 


1990 1995 1997 1998 1999 2000 2001 2002 2003 


9,300 8,635 8,272 8,142 8,698 8,847 8,423 8,103 7,510 
6,897 7,129 6,917 6,762 6,979 6,831 6,325 5,676 5,527 
2,403 1,506 1,355 1,380 1,719 2,016 2,098 2,226 2,083 
1,719 982 726 691 758 863 837 923 817 
265 207 297 367 467 517 523 547 544 
419 317 332 322 494 637 798 756 722 


"Includes cars produced in Canada and Mexico. 
Source: U.S. Bureau of Transportation Statistics, National Transportation Statistics 2004. Data supplied by following source: Motor Vehicle Facts & Figures, 1997. 
Southfield. MI: Ward's Motor Vehicle Facts & Figures, 2002. Southfield, MI: 2002. See also <http://www.bts.gov>. 


Source 


— Represents zero. ‘Change from prior year. 
Source: U.S. Census Bureau, Statistical Abstract of the United States, 2006, table 1024, p. 678. 


Each table should include the following elements: 


Table number. This allows for simple reference from the text to the table. If the text includes 
many tables, a list of tables should be included just after the table of contents. 

Title. The title should indicate the contents of the table and be complete enough to be intel- 
ligible without referring to the text. 

Stubheads and bannerheads. The stubheads contain the captions for the rows of the table, and the 
bannerheads (or boxheads) contain those for the columns. 

Footnotes. Any explanations or qualifications for particular table entries or sections should be 
given in footnotes. 

Source notes. If a table is based on material from one or more secondary sources rather than 
on new data generated by the project, the sources should be acknowledged, usually below 
the table. 


Tables in a survey research report typically follow the format shown in Exhibit 25.7. This 


example cross-tabulates demographics with survey responses. Data from a statistical test also might 
be reported in table form, as shown in Exhibit 25.8. 
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EXHIBIT 25.7 Reporting Format for a Typical Cross-Tabulation 


Age Group 

Online Activity 41-50 

E-mail 89% 88% 92% 90% 94% 90% 89% 
Online games 81% 54% 37% 29% 25% 25% 32% 
Instant messaging 75% 66% 52% 38% 42% 33% 14% 
Downloading music 51% 45% 28% 16% 14% 8% 5% 
Job hunting 30% 62% 51% 40% 36% 17% 2% 
Job research — 44% 59% 59% 54% 31% 13% 


Source: Excerpted from Fox, Susannah and Mary Madden, “Generations Online,’ Pew Internet and American Life Project, December 2005, p. 3, 
http://www.pewinternet.org. 


EXHIBIT 25.8 Reporting Format for a Typical Statistical Test 


Will investors be more cautious about buying stock in companies with questionable advertising? 


Business Advertising Management 


Yes 57% 46% 
No 27 35 
Not sure 16 19 

n = 177 n = 154 


=a  df=2 p<.08 


Source: Report to the Federal Trade Commission on the Effects of the STP “Public Notice” Advertising Campaign, June 1979. 


Suppose an airline asks a question about customers’ satisfaction with its baggage-handling service. 
In addition to showing the simple frequency for each category, most research analysts would cross- 
tabulate answers to the baggage-handling questions with several demographic variables such as gender, 
income, education, and age.To present multiple cross-tabulations individually in separate tables requires 
considerable space. Thus, many research reports use a space-saving format, with either stubheads for 
rows or bannerheads for columns, to allow the reader to view several cross-tabulations at the same time. 
Exhibit 25.9 on the next page presents several cross-tabulations in a single table with stubheads. 


Charts 


Charts translate numerical information into visual form so that relationships may be easily grasped. 
The accuracy of the numbers is reduced to gain this advantage. Each chart should include the fol- 
lowing elements: 


e Figure number. Charts (and other illustrative material) should be numbered in a separate series 
from tables. The numbers allow for easy reference from the text. If there are many charts, a list 
of them should be included after the table of contents. 

e Title. The title should describe the contents of the chart and be independent of the text explana- 
tion. The number and title may be placed at the top or bottom of the chart. 

e — Explanatory legends. Enough explanation should be put on the chart to spare the reader a need to 
look at the accompanying text. Such explanations should include labels for axes, scale numbers, 
and a key to the various quantities being graphed. 

e — Source and footnotes. Any secondary sources for the data should be acknowledged. Footnotes 
may be used to explain items, although they are less common for charts than for tables. 
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EXHIBIT 25.9 Using a Stubhead Format to Include Several Cross-Tabulations in One Table 


Level of Highest Degree 
Nota High Some 


High School College, 
Total School Graduate No 


Characteristic Persons Graduate Only Degree Associate’s Bachelor’s Master’s Professional Doctorate 
All persons* $37,046 $18,734 $27,915 $29,533 $35,958 $51,206 $62,514 SMSA $88,471 
Age: 
25 to 34 years old 33,212 18,920 26,073 28,954 32,276 43,794 51,040 74,120 62,109 
35 to 44 years old 42,475 220123 31,479 36,038 38,442 57,438 66,264 126,165 101,382 
45 to 54 years old 45,908 23,185 32,978 40,291 41,511 59,208 68,344 132,180 92,229 
55 to 64 years old 45,154 23,602 31,742 38,131 39,147 57,423 66,760 138,845 98,433 
65 years old and over 28,918 17,123 20,618 28,017 23,080 41,323 42,194 77,312 56,724 
Sex: 
Male 44,726 21,447 33,286 36,419 43,462 63,084 76,896 136,128 95,894 
Female 28,367 14,214 21,659 22,615 29,537 38,447 48,205 72,445 73,516 


“For persons 18 years old and over with earnings. 
Source: Excerpted from U.S. Census Bureau, Statistical Abstract of the United States, 2006, Table 217, p. 148. 


Charts are subject to distortion, whether unintentional or deliberate. Exhibit 25.10 shows how 
altering the scale changes the reader’s impression of the data.A particularly severe kind of distortion 
comes from treating unequal intervals as if they were equal; this generally results from a deliberate 
attempt to distort data. Exhibit 25.11 shows this type of distortion. In this example, someone has 
attempted to make the rise on the chart more dramatic by compressing the portion in which the 
data show little real change. 


EXHIBIT 25.10 
Distortion by Alternating Changing the Visual Image 
Scales Contracting or expanding vertical (amount) scale or horizontal 
(time) scale tends to change the visual picture 
Expanding Vertical 
Original Scale Contracting and Contracting 
Arrangement Expanding Vertical Horizontal Expanding Horizontal Horizontal 
ESoeEe5 
Contracting Vertical Contracting Vertical and Expanding Horizontal 


Source: Adapted with permission from Spear, Mary Eleanor, Practical Charting Techniques (New York: McGraw-Hill, 1969), 
p. 56. 


Another common way of introducing distortion is to begin the vertical scale at some value 
larger than zero. Exhibit 25.12 shows how this exaggerates the amount of change in the period 
covered. This type of broken scale is often used in published reports of stock price movements. 
In this case, it is assumed that the reader is interested mostly in the changes and is aware of the 
exaggeration. For most research reports, however, this assumption is not valid. The vertical axis of 
a graph should start at zero. 
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(a) $ millions (b) $ millions 
$60 $60 
50 50 
40 40 
30 30 
20 20 
10 10 
0 0 
RRSSRSS 1970 1975 1980 1985 1990 1995 2000 
eee aI 


Source: Adapted with permission from Spear, Mary Eleanor, Practical Charting Techniques (New York; McGraw-Hill, 1969), 


p.57. 
Units Sold 
JJ Full Price 
I) 20% Off 
50% Off 
PIE CHARTS 


One of the most useful kinds of charts is the pie chart, which shows the composition of some total 
quantity at a particular time. As shown in the example in Exhibit 25.13 on the next page, each angle, 
or “slice,” is proportional to its percentage of the whole. Companies often use pie charts to show how 
revenues were used or the composition of their sales. Each of the segments should be labeled with its 
description and percentage. The writer should not try to include too many small slices; about six slices 
is a typical maximum. 
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EXHIBIT 25.11 

Distortion from Treating 
Unequal Time Intervals as 
Equal 


EXHIBIT 25.12 

A Simple Pie Chart with 
Slices Representing the 
Frequency of Sales at Each 
Price Level 
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EXHIBIT 25.13 
Pie Charts 


EXHIBIT 25.14 
Simple Line Graph 
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U.S. Energy Consumption, 2004 U.S. Electricity Generation, 2004 
Total = 100 quadrillion Btu Total = 3,953 billion kWh 


a Petroleum a Nuclear Power 
| Natural Gas Renewable Energy 
[E coal & Coal Coke 


Source: Energy Information Administration, U.S. Department of Energy, “Renewable Energy Sources: A Consumer's 
Guide,’ EIA Brochures, http://www.eia.doe.gov, accessed March 28, 2006. 


E LINE GRAPHS 


Line graphs are useful for showing the relationship of one variable to another. The dependent 
variable generally is shown on the vertical axis, and the independent variable on the horizontal 
axis. The most common independent variable for such charts is time, but it is by no means the only 
one. Exhibit 25.14 depicts a simple line graph. 


Spending on Prescription Drugs 


Billions of Dollars 
wo 
[==] 
fan} 
T 


=e 

S 

S) 
I 


0 | | | | 
1960 1970 1980 1990 2000 2010* 2020 


Year 


*Projected data for 2004-2014. 


Source: Data from U.S. Census Bureau, Statistical Abstract of the United States, 2006, Table 118, p. 98. 
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Variations of the line graph also are useful. The multiple-line graph, such as the example in 
Exhibit 25.15, shows the relationship of more than one dependent variable to the independent 
variable. The line for each dependent variable should be in a different color or pattern and should 
be clearly labeled. The writer should not try to squeeze in too many variables; this can quickly lead 
to confusion rather than clarification. 

A second variation is the stratum chart, which shows how the composition of a total quantity 
changes as the independent variable changes. Exhibit 25.16 provides an example. The same cau- 
tions mentioned in connection with multiple-line graphs apply to stratum charts. 


EXHIBIT 25.15 


Median Age of Motor Vehicles Multiple-Line Graph 
10 
Cars 
8 | $e 
Oil Light Trucks 
4 = 
2 E 
| | | | | | 


l l l J 
: 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 


Median Age (Years)* 
*Age calculated as of July 1. 


Source: Data from Dolliver, Mark “Aging of America, Vehicular Division,’ Adweek, March 6, 2006, downloaded from InfoTrac 
at http://web2.infotrac.galegroup.com. 


EXHIBIT 25.16 
Costs of Regulation Stratum Chart 


$800 


700 E Other Social Regulation 
600 L Wi Economic Regulation 


Efficiency Costs 
500 m 
400 
300 
200 


100 


Environmental Regulation E Economic Regulation 


Transfer Costs 
E Paperwork 


0 l l l | I l | I | I 
Te ‘80 PA ‘84 ‘86 ‘88 ‘90 ‘92 ‘94 '96 LE 2000 


BAR CHARTS 


A bar chart shows changes in the value of a dependent variable (plotted on the vertical axis) at 
discrete intervals of the independent variable (on the horizontal axis). A simple bar chart is shown 
in Exhibit 25.17 on the next page. 
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EXHIBIT 25.17 
Simple Bar Chart 


EXHIBIT 25.18 
Subdivided Bar Chart 
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Adults Who Have Undergone Cosmetic Treatments 


"Other cosmete ¢ert! ork a 72 
other cosmetic dental work 3 
Lasik surgery to correct vision M 3% 
Cosmetic surgery” ME 3% 


Bariatric surgery for weight loss M 1% 


Type of Treatment 


Facial skin resurfacing treatment** E 1% 


Laser treatment for veins, 
hair removal, etc. 


Percent 


*Includes face lift, chin implant, tummy tuck, etc. 
**Includes chemical peels, laser abrasion, etc. 


Source: Data from Harris Interactive, “Despite Risks, Adults Not Shying Away from Cosmetic Surgery and Other Treat- 
ments,’ news release, February 13, 2006, http://www.harrisinteractive.com. Accessed April 4, 2006. 


Like the line graph, the bar chart format has variations.A common variant is the subdivided-bar chart 
(see Exhibit 25.18). It is much like a stratum chart, showing the composition of the whole quantity. 
The multiple-bar chart (see Exhibit 25.19) shows how multiple variables are related to the primary vari- 
able. In each of these cases, each bar or segment of the bar needs to be clearly identified with a differ- 
ent color or pattern. The writer should not use too many divisions or dependent variables. Too much 
detail obscures the essential advantage of charts, which is to make relationships easy to grasp. 


2004 Average 
Retail Price: $1.85/gallon 
2000 Average 
Retail Price: $1.48/gallon 12% 
12% 


MW crude oil 


Distribution & Marketing 
Costs & Profits 
| Refining Costs & Profits 
H Federal & State Taxes 
E) 


Source: Energy Information Administration, U.S. Department of Energy, “A Primer on Gasoline Prices,’ EIA Brochures, 
http://www.eia.doe.gov, accessed March 28, 2006. 
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Recent Best Selling Cars in the U.S.A. 
700,000 


600,000 


500,000 


400,000 


300,000 


Units Sold 


200,000 


100,000 


2007 2008 


E Chevy Impala mi Honda Civic W Toyota Camry m Honda Accord 
Chevy Silvarado ™ Ford F-150 = Dodge Ram 


Source: “Forbes.com—10 Best Selling Vehicles of 2007,” http://www.autospies.com/news/Forbes-com-10-Best-Selling- 
Vehicles-of-2007-23985/, accessed December 22, 2008; Mitchell, Jacqueline, “The Year's Best- And Worst-Selling Cars,’ http:// 
www.forbes.com/2008/12/03/2008-car-sales-forbeslife-cx_jm_1203cars.html, accessed December 22, 2008. 


The Oral Presentation 


The conclusions and recommendations of most research reports are presented orally as well as 
in writing. The purpose of an oral presentation is to highlight the most important findings of a 
research project and provide clients or line managers with an opportunity to ask questions. The oral 
presentation may be as simple as a short video conference with a manager at the client organiza- 
tion’s location or as formal as a report to the company board of directors. 

In either situation, the key to effective presentation is preparation. The Research Snapshot on 
the next page provides some recommendations that can help you as a presenter. Communication 
specialists often suggest that a person preparing an oral presentation begin at the end.’ In other 
words, while preparing a presentation, a researcher should think about what he or she wants the 
client to know when it has been completed. The researcher should select the three or four most 
important findings for emphasis and rely on the written report for a full summary. The researcher 
also needs to be ready to defend the results of the research. This is not the same as being defensive; 
instead, the researcher should be prepared to deal in a confident, competent manner with the ques- 
tions that arise. Remember that even the most reliable and valid research project is worthless if the 
managers who must act on its results are not convinced of its importance. 

As with written reports, a key to effective oral presentation is adapting to the audience. Deliv- 
ering an hour-long formal speech when a ten-minute discussion is called for (or vice versa) will 
reflect poorly on both the presenter and the report. 

Lecturing or reading to the audience is sure to impede communication at any level of for- 
mality. Presenters should refrain from reading prepared text word for word. By relying on brief 
notes, familiarity with the subject, and as much rehearsal as the occasion calls for, presenters will 
foster better communication. Presenters should avoid research jargon and use short, familiar words. 
Presenters should maintain eye contact with the audience and repeat the main points. Because 
the audience cannot go back and replay what the speaker has said, an oral presentation often is 
organized around a standard format: “Tell them what you are going to tell them, tell them, and tell 
them what you just told them.” 
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Multiple-Bar Chart 


oral presentation 


A spoken summary of the major 
findings, conclusions, and recom- 
mendations, given to clients or 
line managers to provide them 
with the opportunity to clarify 
any ambiguous issues by asking 
questions. 


© SPENCER GRANT/PHOTOEDIT 


The 10/20/30 Rule of PowerPoint 
Many business researchers find themselves being asked to pro- 
vide a presentation of research findings to different stakeholders. 
Given today’s reliance on visual technology, it is natural to develop 
a presentation using Microsoft's PowerPoint presentation soft- 
ware. But a poorly developed PowerPoint presentation can limit your 
impact. One way to avoid this is to use Guy Kawasaki's 10/20/30 Rule of 
PowerPoint. 

The “10” refers to the number of optimal slides to have 
for your presentation. More than 10 slides can cause your 
audience to lose interest, causing them to disregard your 
research findings. The “20” part of the rule is related to the time 


many instances the opportunity to discuss 
or ask questions regarding your research 
is more valuable than the presentation 
itself. Finally, Kawasaki recommends that 
PowerPoint presentations use, as a mini- 
mum, 30-point font size. Readability is more 

important than an overkill of information that is unreadable to 
the audience. Kawasaki even provides a more flexible corollary 
to the “30” rule—take the age of the oldest person in the audi- 
ence, and divide by two! Regardless of the size of the font or the 
length of the presentation, communicating research should be 


done carefully, to maximize the impact of the results you obtain. 


Your Money 
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to actually present the results. Perhaps the 10/20/30 rule can work for you! 
In a typical hour-long meeting, 
any presentation over 

20 minutes will start to lose 


your audience as well, and in 


Source: Kawasaki, Guy, “The 10/20/30 Rule of PowerPoint,’ How to Change the World 
(December 30, 2005), http://blog.guykawasaki.com/2005/12/the_102030_rule.html, 
accessed April 28, 2009. 


Graphic and other visual aids can be as useful in an oral presentation as in a written one. 
Presenters can choose from a variety of media. Slides, overhead-projector acetates, and on-screen 
computer-generated graphics are useful for larger audiences. For smaller audiences, the researcher 
may put the visual aids on posters or flip charts. Another possibility is to make copies of the charts 
for each participant, possibly as a supplement to one of the other forms of presentation. 

Whatever medium is chosen, each visual aid should be designed to convey a simple, attention- 
getting message that supports a point on which the audience should focus its thinking. As they do 
in written presentations, presenters should interpret graphics for the audience. The best slides are 
easy to read and interpret. Large typeface, multiple colors, bullets that highlight, and other artistic 
devices can enhance the readability of charts. 

Using gestures during presentations also can help convey the message and make presentations 
more interesting. Here are some tips on how to gesture:* 


e Open up your arms to embrace your audience. Keep your arms between your waist and 
shoulders. 

e Drop your arms to your sides when not using them. 

e Avoid quick and jerky gestures, which make you appear nervous. Hold gestures longer than 
you would in normal conversation. 

e Vary gestures. Switch from hand to hand and at other times use both hands or no hands. 

e Don’t overuse gestures. 


Some gestures are used to draw attention to points illustrated by visual aids. For these, gesturing 
with an open hand can seem more friendly and can even release tension related to nervousness. In 
contrast, a nervous speaker who uses a laser pointer may distract the audience as the pointer jumps 
around in the speaker’s shaky hand.* 


Reports on the Internet 


Many clients want numerous employees to have access to research findings. One easy way to share 
data is to make executive summaries and reports available on a company Intranet. In addition, a com- 
pany can use information technology on the Internet to design questionnaires, administer surveys, 
analyze data, and share the results in a presentation-ready format. Real-time data capture allows for 
beginning-to-end reporting. A number of companies offer fully Web-based research management 
systems—for example, WebSurveyor’s online solution for capturing and reporting research findings. 
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+ Much of the research you conduct will analyses is not always the best way to draw in your audience. 
generate numerous tables of results. An overreliance on statistical jargon should be avoided. 
Not all results are necessarily relevant. e Presentation skills mean, at a minimum, practice. To “wing it” 
Make sure you choose carefully what at the last minute may reduce your credibility, and possibly 
should be reported, and what should the credibility of your research as well. 
not be reported. + The research report is much like your business card—it is a 

+ Too often the sophistication of statistics can be off-putting reflection of you to others. Professionalism is reflected in your 
to others. Demonstrating your mastery of complex statistical care and craftsmanship of the report. 


The Research Follow-Up 


Research reports and oral presentations should communicate research findings so that managers 
can make business decisions. In many cases, the manager who receives the research report is unable 
to interpret the information and draw conclusions relevant to managerial decisions. For this rea- 
son, effective researchers do not treat the report as the end of the research process. They conduct 
a research follow-up, in which they recontact decision makers and/or clients after the latter have 
had a chance to read over the report. The purpose is to determine whether the researchers need to 
provide additional information or clarify issues of concern to management. 


Summary 


1. Discuss the research report from the perspective of the communications process. A research 
report is an oral or written presentation of research findings directed to a specific audience to 
accomplish a particular purpose. Report preparation is the final stage of the research project. It is 
important because the project can guide management decisions only if it is effectively commu- 
nicated. The theory of communications emphasizes that the writer (communicator) must tailor 
the report (message) so that it will be understood by the manager (audience), who has a different 
field of experience. 


2. Define the parts of a research report following a standard format. The consensus is that the 
format for a research report should include certain prefatory parts, the body of the report, and 
appended parts. The report format should be varied to suit the level of formality of the particu- 
lar situation. The prefatory parts of a formal report include a title page, letters of transmittal and 
authorization, a table of contents, and a summary. The summary is the part of a report most often 
read and should include a brief statement of the objectives, results, conclusions, and (depending 
on the research situation) recommendations. The report body includes an introduction that gives 
the background and objectives, a statement of methodology, and a discussion of the results, their 
limitations, and appropriate conclusions and recommendations. The appendix includes various 
materials too specialized to appear in the body of the report. 


3. Explain how to use tables for presenting numerical information. Tables present large amounts 
of numerical information in a concise manner. They are especially useful for presenting several 
pieces of information about each item discussed. Short tables are helpful in the body of the report; 
long tables are better suited for an appendix. Each table should include a number, title, stubheads 
and bannerheads, footnotes for any explanations or qualifications of entries, and source notes for 
data from secondary sources. 


4. Summarize how to select and use the types of research charts. Charts present numerical data in 
a way that highlights their relationships. Each chart should include a figure number, title, explana- 
tory legends, and a source note for secondary sources. Pie charts show the composition of a total 
(the parts that make up a whole). Line graphs show the relationship of a dependent variable (on 
the vertical axis) to an independent variable (horizontal axis). Most commonly, the independent 
variable is time. Bar charts show changes in a dependent variable at discrete intervals of the inde- 
pendent variable—for example, comparing one year with another or one subset of the population 
with another. Variants of these charts are useful for more complex situations. 


research follow-up 


Recontacting decision makers 
and/or clients after they have had 
a chance to read over a research 


report in order to determine 


whether additional information 


or clarification is necessary. 
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5. Describe how to give an effective oral presentation. Most research projects are reported orally 
as well as in writing, so the researcher needs to prepare an oral presentation. The presentation 
should defend the results without being defensive. The presentation must be tailored to the situa- 
tion and the audience. The presenter should practice delivering the presentation in a natural way, 
without reading to the audience. Graphic aids are useful supplements when they are simple and 
easy to read. Gestures also add interest and emphasis. 


6. Discuss the importance of Internet reporting and research follow-up. Posting a summary of 
results online gives clients ready access to that information. Some online survey software processes the 
data and displays results in a presentation-ready format. In the follow-up stage of a research project, 
the researchers recontact decision makers after submitting the report. This helps the researchers 
determine whether they need to provide further information or clarify any issues of concern to 
management. 


Key Terms and Concepts 


communication process, 609 introduction section, 615 research methodology section, 616 


conclusions and recommendations oral presentation, 625 research report, 671 


section, 617 results section, 616 


graphic aids, 617 


report format, 611 
research follow-up, 627 


Questions for Review and Critical Thinking 


1. Why is it important to think of the research report from a com- 


munications perspective? 
As a manager, what degree of formality would you want from 


In preparing for a presentation to the Hi Time Board, the 
client tells the researcher that the chart doesn’t seem to reflect 
the improvements made since 2006. Therefore, the researcher 


your research department? 
3. What types of tables might be used to describe some of the 
statistical tests discussed in previous chapters? 


prepares the chart as shown here: 


4. What is the difference between a basic business research paper and 250 
an applied research report? 
5. What is a pie chart? What is a bar chart? When might one be 
245 
preferable over the other? 
6. What are some basic business research journals? Find some pub- 
lished research reports in these journals. How do they meet the 240 E So Cool 
standards set forth in this chapter? E Hi Time 
7. What rules should be followed when preparing slides for 
computer-generated presentations? an 
8. ETHICS What ethical concerns arise when you prepare (or read) 
a report? 230 
9. ETHICS A researcher working for Hi Time prepares a bar chart 
comparing the number of customers visiting two competing 225 


booths at a fashion trade show. One booth is the Hi Time booth, 
and the other is for a competing company, So Cool. First, the 


2006 


2007 


chart is prepared as shown here: : . 
a a. What has reformatting the bar chart accomplished? 


250 b. Was it ethical for the client to ask for the bar chart to be 
redrawn? 
200 c. Would it be ethical for the researcher to use the new chart 
in the presentation? 
150 B So Cool 
E Hi Time 


100 
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Research Activity 


1. ‘NET Input “Starbucks” or “McDonald’s” in an Internet search 
engine available through your library’s reference service or even 
a general search engine like Google News. Look at the news 
and articles for that company. Limit the search by using the 


word “report.” Find one of the articles that actually presents 
some research reports, such as consumer reactions to a new 
product. Prepare power point slides that contain appropriate 
charts to present the results. 


Case 25.1 Annenberg Public Policy Center 


© GETTY IMAGES/ 


A recent study by the Annenberg Public Policy 
Center investigated one major area of business 
decisions: pricing practices.° Specifically, the study 
addressed consumer knowledge and attitudes 


about the practice of online retailers adjusting their 


PHOTODISC GREEN 


l prices according to customer characteristics, such 

as how frequently they buy from the retailer. For example, a Web site 
selling cameras charged different prices for the same model depend- 
ing on whether the visitor to the site had previously visited sites that 
supply price comparisons. In general, charging different prices is called 
price discrimination and is legal unless it discriminates by race or sex or 
involves antitrust or price-fixing laws (such as two competitors agreeing 
to charge certain prices). 

The Annenberg study consisted of telephone interviews conducted 
with a sample of 1,500 adults, screened to find persons who had used 
the Internet in the preceding 30 days. The questionnaire gathered 
demographic data and data about Internet usage. In addition, the inter- 


Selected Information about the Sample 


Sex 

Male 48% 
Female 52% 
Online Connection at Home 

Dial-up connection only 31% 
Cable modem (with/without dial-up) 18% 
DSL (with/without dial-up) 25% 
Cable or DSL with another method 13% 
Don't know 4% 
No connection at home 9% 


Self-Ranked Expertise Navigating the Internet 


Beginner 14% 
Intermediate 40% 
Advanced 34% 
Expert 12% 


Source: Turow, Joseph, Lauren Feldman, and Kimberly Meltzer, “Open to 
Exploitation: American Shoppers Online and Offline,’ APPC report, June 
2005, p. 15, downloaded at http://www.annenbergpublicpolicycenter.org. 


viewer read 17 statements about basic laws and practices related to price 
discrimination and the targeting of consumers according to their 
shopping behaviors. Respondents were asked whether each of these 
statements was true or false. Case Exhibits 25.1-1 through 25.1-4 
summarize some of the results from this study. 


Questions 

1. The information provided here is not detailed enough for a for- 
mal report, but assume that you are making an informal report 
in a preliminary stage of the reporting process. Which of these 
findings do you want to emphasize as your main points? Why? 

2. Prepare a written summary of the findings, using at least two 
tables or charts. 

3. Prepare two tables or charts that would be suitable to accompany 
an oral presentation of these results. Are they different from the 
visual aids you prepared for question 2? Why or why not? 


Responses to Selected Knowledge Questions 


Response* 


Statement True False 


Companies today have the 80% 8% 12% 
ability to follow my activity 
across many sites on the Web. 
It is legal for an online store to 38% 
charge different people different 


prices at the same time of day. 


29% 33% 


By law, a site such as Expedia 37% 32% 31% 
or Orbitz that compares prices 
on different airlines must include 


the lowest airline prices. 


It is legal for an offline store 29% 
to charge different people 
different prices at the 


same time of day. 


42% 29% 


When a Web site has a 

privacy policy, it means the 

site will not share my 
information with other websites 
or companies. 


59% 25% 16% 


*When the numbers do not add up to 100%, it is because of a rounding 
error. Boldface type indicates the correct answer. 


Source: Turow, Joseph, Lauren Feldman, and Kimberly Meltzer, “Open to 
Exploitation: American Shoppers Online and Offline,’ APPC report, June 
2005, p. 20, downloaded at http://www.annenbergpublicpolicycenter.org/ 
Downloads/information_and_society/turow_appc_report_web_final.pdf. 
Accessed June 15, 2009. 
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CASE EXHIBIT 25.1-3 Responses to Selected Attitude Questions CASE EXHIBIT 25.1-4 Predicting Knowledge Score from Selected 
Demographics 
Response* 
Unstandardized Standardized 
Don’t Regression Regression 

Statement Agree Disagree Neutral Know Coefficient (B) Coefficient (£) 
It’s okay if a store charges 8% 91% — 1% Education 0.630* 0.200 
me a price based on 
what it knows about me. Income 0.383* 0.150 
It’s okay if an online store 11% 87% 1% 1% Self-perceived ability to 0.616* 0.149 
| use charges different navigate Internet 
people different prices for 
the same products during Constant 2.687 
the same hour. 

Re 0.148 
It would bother me to 76% 22% 1% 1% 
learn that other people *Significance < 0.001 level. 
pay less than | do for the 
same products. Source: Turow, Joseph, Lauren Feldman, and Kimberly Meltzer, “Open to 

Exploitation: American Shoppers Online and Offline,’ APPC report, June 
It would bother me if 57% 41% 2% 1% 2005, p. 29, downloaded at http://www.annenbergpublicpolicycenter.org/ 
websites | shop at keep Downloads/information_and_society/turow_appc_report_web_final.pdf. 
detailed records of my Accessed June 15, 2009. 
buying behavior. 
It's okay if a store | shop 50% 47% 2% 1% 
at frequently uses 


information it has about 
me to create a picture of 
me that improves the 
services it provides for me. 


*When the numbers do not add up to 100%, it is because of a rounding 
error. 


Source: Turow, Joseph, Lauren Feldman, and Kimberly Meltzer, “Open to 
Exploitation: American Shoppers Online and Offline,’ APPC report, June 
2005, p. 22, downloaded at http://www.annenbergpublicpolicycenter.org. 
Accessed April 7, 2006. 


Case 1 Running the Numbers: Does It Pay? 


(Download the data sets for this case from www.cengage. 
com/marketing/zikmund or request them from your instructor.) 
Dr. William Ray, a research consultant, has received a government 
grant of $75,000 to fund research examining how aspects of a student’s 
college experiences relate to his or her job performance. Senator B. I. G. 
Shot is being lobbied by his constituents that employers are discriminat- 
ing against people who do not like math by giving them lower salaries. 
Senator Shot has obtained $50,000 of the $75,000 grant from these 
constituents. The senator was also instrumental in the selection of Dr. 
Ray as the recipient and hopes the research supported by the grant will 
help provide a basis to support the proposed legislation making 
discrimination against people who do not like math illegal. 

The research questions listed in this particular grant proposal include: 


RQ!1: Does a student’s liking of quantitative coursework in college 


fit this profile. The invitation explained that the research was about 
various employee attitudes and indicated that employees would not 
be required to identify themselves during the survey. Respondents 
were informed that all responses would be strictly confidential. 
The e-mail provided a click-through questionnaire which directed 
respondents to a Web site where the survey was conducted using an 
online survey provider. Each invitation was coded so that the actual 
respondents could be identified by both e-mail address and name. 
Dr. Ray, however, kept this information confidential so the com- 
pany could not identify any particular employee’s response. 

The following table describes the variables that were collected. 


Variables Available from Company Records 


Variable Name Variable Type Coding 


CCRC OPC u can mae PROM Nominal indicating whether 1 = “Promoted” 
affect iis or her future earnings: the employee has been 0 = “Not Promoted” 
RQ2: Do people with an affinity for quantitative courses get pro- promoted 
moted more quickly than those who do not? GPA Self-Reported GPA in Last 0 (lowest) to 
Year of College 4 (highest 
Dr. Ray has gained the cooperation of a Fortune 500 service firm ; g aces 
; : Sex Nominal 1 =“Female” 
that employs over 20,000 employees across eight locations. The 0 = “Male” 
company allows Dr. Ray to survey employees who have been out of Sdad Nonie Seac iele 
college for three years. Three hundred responses were obtained by 
: oS awe : = Salary Ratio Actual Annual 
sending an e-mail invitation to approximately 1,000 employees who Salary from Last Year 
Questions from Survey 
Strongly Disagree Disagree Neutral Agree Strongly Agree 
Coding (1) (2) (3) (4) (5) 
X, The quantitative courses | took in Oo m El El El 
school were the most useful courses. 
X, Very few topics can be understood if you 
do not understand the arithmetic. 
X, | hated going to math classes in college. m m E E E 
X, learned a great deal from the quantitative m m O m m 
projects assigned to me in college. 
X, Students do not need to study quantitative m 


topics in college to succeed in their careers. 
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Please use the following items to describe your undergraduate college experience. For each pair of items, choose the check box closest to the adjective 


that best describes your experience. 


Coding (-3) (-2) (-1) (0) (1) (2) (3) 
S, Dull Exciting 
S, Laborious Playful 
S, Stressful Relaxing 
S, Boring Fun 
S, Carefree Responsible 
Questions: 5. List another hypothesis (unrelated to the research questions in 


1. Does this grant present Dr. Ray with an ethical dilemma(s) in 
any way? 

2. Derive at least one hypothesis for each research question listed 
above. Provide a sound rationale or theoretical explanation that 
leads to the hypothesis. 

3. Use the data that corresponds to this case to perform an ade- 
quate test of each hypothesis. Interpret the results. 

4. Is there evidence supporting the discrimination claim? Explain. 


the grant) that could be tested with this data. 

6. Test that hypothesis. 

7. Considering employees’ attitudes about their college experi- 
ence, does the amount of fun that students had in college or the 
degree to which they thought quantitative classes were a posi- 
tive experience relate more strongly to salary? 

8. Would the “problem” that led to the grant be a better candidate 
for ethnographic research? Explain. 


Case 2 Attiring Situation 


RESER V is a national level placement firm specializing in 
putting retailers and service providers together with potential 
employees who fill positions at all levels of the organization. This 
includes entry-level positions and senior management positions. 
One international specialty clothing store chain has approached 
them with issues involving key characteristics of retail employ- 
ees. The two key characteristics of primary interest involve the 
appearance of potential employees and problems with customer 
integrity. 

Over the last five years, store management has adopted a very 
relaxed dress code that has allowed employees some flexibility 
in the way they dress for work. Casual attire was permitted with 
the idea that younger customers could better identify with store 
employees, most of whom are younger than average. However, 
senior management had just become aware of how some very 
successful companies tightly control the appearance of their sales 
force. The Walt Disney Company, for example, has strict groom- 
ing policies for all employees, provides uniforms (or costumes) for 
most cast members, and does not permit any employees to work 
if they have visible tattoos. Disney executives discuss many posi- 
tive benefits from this policy and one is that customers are more 
responsive to the employees. Thus, it just may be that the appear- 
ance of employees can influence the behavior of customers. This 
influence can be from the greater identity that employees display— 
meaning they stand out better and may encourage acquiescence 
through friendliness. 

Senior research associate Michael Neil decides to conduct an 
experiment to examine relevant research questions including: 


RQ1: How does employee appearance affect customer purchas- 
ing behavior? 
RQ2: How does employee appearance affect customer ethics? 


Mr. Neil decides the problem can best be attacked by conducting a 
laboratory experiment. In the experiment, two variables are manip- 
ulated in a between-subjects design. The experiment includes two 
experimental variables which are controlled by the researcher and 


by the subjects’ biological sex, which was recorded and included as 
a blocking variable. The experimental variables (and blocking vari- 


able) are: 
Name Description Values 
X, A manipulation of the 0 = Professional Attire 
attire of the service- (Neatly groomed w/ 
providing employee business attire) 
1 = Unprofessional Attire 
(Unkempt hair w/jeans 
and t-shirt) 
X, The manner with which 0 = Soft Close 
the service-providing 1 = Hard Close 
employee tries to gain 
extra sales—or simply, 
the close approach 
Gender Subject’s biological 0 = Male 
Sex 1 = Female 
Three dependent variables are included: 
Name Description Range 
Time How much time the 0-10 minutes 
subject spent with the 
employee beyond what 
was necessary to choose 
the slacks and shirt. 
Spend How much of the $25 the $0-$25 
subject spent on extra 
products offered for sale by 
the retail service provider 
Keep How much of the $25 $0-$25 


the subject kept rather 
than returning to the 
researcher 


Additionally, several variables were collected following the experiment 
that tried to capture how the subject felt during the exercise. All of 
these items were gathered using a 7-item semantic differential scale. 
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Name Description 
SD, Low Quality—High Quality 
SD, Dislike-Like 
SD, Unfavorable-Favorable 
SD, Negative—Positive 
SD, Easy-Difficult 
SD, Restful-Tiring 
SD3 Comfortable-Uncomfortable 
SD Calm-Tense 


The experiment was conducted in a university union. Subjects were 
recruited from the food court area. RESERV employees approached 
potential subjects and requested their participation in a study that 
examined how customers really bought things. Subjects would each 
receive vouchers that could be exchanged for merchandise in return 
for their participation. Each potential subject was informed that the 
participation could take between 20 and 40 minutes to complete. 
Upon agreeing to participate, subjects were escorted to a waiting 
area where they were provided with further instructions and min- 
gled with other participants before entering a small room that was 
set up to resemble an actual retail clothing counter. 

Each subject was told to play the role of a customer who had 
just purchased some dress slacks and a shirt. The employee was to 
complete the transaction. Once the subject entered the mock retail 
environment, a research assistant who was playing the role of the 
retail employee entered the room. As a retail sales associate, one 
important role was to suggest add-on sales. Several dozen accessory 
items ranging from socks and handkerchiefs to small jewelry items 
were displayed at the counter. 

As a result of this experimental procedure, each subject was 
randomly assigned to one of four conditions, each corresponding to 
a unique combination of the experimental variables described above. 
In other words, the employee was either: 


1. Dressed professionally and used a soft close (i.e., “Perhaps you 
would like to see some additional accessories”) in trying to sell 
merchandise beyond the slacks and shirt. 
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Dressed unprofessionally and used a soft close. 


& bw 


Dressed professionally and used a hard close (i.e., “You really 
need to match this up with some coordinated accessories which 
happen to be on sale today only”) in trying to sell merchandise 
beyond the slacks and shirt. 

4. Dressed unprofessionally and used a hard close. 


Thus, RESERV wishes to use this information to explain how 
employee appearance encourages shoppers to continue shopping 
(TIME) and spend money (SPEND). Rather than simply ask pur- 
chase intentions, researchers gave each subject $25 (in one-dollar bills) 
which they were allowed to spend on accessories. This allowed each 
subject to participate in an actual transaction. In addition, the experi- 
ment did not provide explicit instructions on what was to be done 
with the money that was left over. Once the simulated shopping trip 
was complete, subjects were taken to another small room where they 
answered a questionnaire containing the semantic differential scales 
and demographic information which they completed while alone 
and at their own pace. Because the instructions did not specifically 
tell subjects what to do with the money they possessed following the 
experiment, this allowed the researchers to operationalize a behavioral 
dependent variable (KEEP) that simulated questionable behavior based 
on the implied assumption that the money was to be either handed to 
the research assistant when the shopping trip was complete or turned 
in along with the questionnaire. In other words, subjects who kept 
money were considered as behaving less ethically than those who left 
the money behind or turned it in to a member of the research team. 


1. Develop at least three hypotheses that correspond to the 
research questions. 

2. Test the hypotheses using an appropriate statistical approach. 

3. Suppose the researcher is curious about how the feelings cap- 
tured with the semantic differentials influence the dependent 
variables SPEND and KEEP. Conduct an analysis to explore this 
possibility. Are any problems present in testing this? 

4. Is there a role for factor analysis in any of this analysis? 

5. Critique the experiment from the viewpoint of internal and 
external validity. 

6. What conclusions would be justified by management regarding 
their employee appearance policy? 


Case 3 Values and the Automobile Market 


(Download the data sets for this case from www.cengage.com/ 
marketing/zikmund or request them from your instructor.) In the 
last decade, the luxury car segment became one of the most com- 
petitive in the automobile market. Many American consumers who 
purchase luxury cars prefer imports from Germany and Japan. 

A marketing vice president with General Motors once com- 
mented, “Import-committed buyers have been frustrating to us.” 
This type of thinking has led industry analysts to argue that to suc- 
cessfully compete in the luxury car segment, U.S. carmakers need to 
develop a better understanding of consumers so that they can better 
target market segments and better position their products via more 
effective advertising. Insight into the foreign-domestic luxury car 
choice may result from examining owners’ personal values in addi- 
tion to their evaluations of car attributes, because luxury cars, like 
many other conspicuously consumed luxury products, may be pur- 
chased mainly for value-expressive reasons. 

Industry analysts believe it would be important to assess whether 
personal values of consumers could be used to explain ownership of 


American, German, and Japanese luxury cars. Further, they believe 
they should also assess whether knowledge of owners’ personal val- 
ues provides any additional information useful in explaining owner- 
ship of American, German, and Japanese luxury cars beyond that 
obtained from their evaluations of the cars’ attributes. 

Personal values are likely to provide insights into reasons for 
ownership of luxury cars for at least two reasons. First, Americans 
have always had very personal relationships with their cars and have 
used them as symbols of their self-concepts. For instance, people who 
value a sense of accomplishment are quite likely to desire a luxury car 
that they feel is an appropriate symbol of their achievement, whereas 
people who value fun, enjoyment, and excitement are likely to desire a 
luxury car that they perceive as fun and exciting to drive. An adver- 
tiser trying to persuade the former segment to purchase a luxury car 
should position the car as a status symbol that will help its owners 
demonstrate their accomplishments to others. Similarly, an advertiser 
trying to persuade the latter segment to purchase a luxury car should 
position the car as a fun and exciting car to drive. In other words, 
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effective advertising shows consumers how purchasing a given prod- 
uct will help them achieve their valued state, because brands tied 

to values will be perceived more favorably than brands that deliver 
more mundane benefits. 

Second, when a market is overcrowded with competing brands 
offering very similar options—as is the case with the luxury car 
market—consumers are quite likely to choose between brands on 
the basis of value-expressive considerations. 


METHOD 


Data were collected via a mail survey sent to 498 consumers chosen 
at random from a list obtained from a syndicated research company 
located in an affluent county in a southern state. The list contained 
names of people who had purchased either an American luxury car 
(Cadillac or Lincoln Mercury), a German luxury car (Mercedes or 
BMW), or a Japanese luxury car (Infiniti or Lexus) within the last 
year. A cover letter explained that the survey was part of an aca- 
demic research project. People were asked to return the question- 
naires anonymously to a university address. (A postage-paid envelope 
was provided with each survey.) A notice was included that stated 
that the project was approved by the University Internal Review 
Board and emphasized the fact that participation was voluntary. 
Beyond an appeal to help the researchers, respondents were not 
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offered any other incentive to complete the surveys. Of the 498 
questionnaires originally sent, 17 were returned by the post office 
as undeliverable. One hundred fifty-five completed surveys were 
received, for a response rate of 32.2 percent. 


The Survey Instrument 

The survey included questions on (1) various issues that people 
consider when purchasing new cars, (2) importance of car attributes, 
(3) importance of different values, and (4) demographics (sex, age, 
education, and family income). Questions relating to the issues that 
people consider when purchasing new cars were developed through 
initial interviews with consumers and were measured with a 7-point 
Likert scale with end anchors of “strongly agree” and “strongly dis- 
agree.” (See Case Exhibit 3.1.) A list of 12 car attributes was devel- 
oped from the initial interviews with consumers and by consulting 
Consumer Reports. (See Case Exhibit 3.2.) The importance of each 
attribute was measured with a 7-point numerical scale with end 
points labeled “very important” and “very unimportant.” The List 
of Values (LOV) scale in Case Exhibit 3.3 was used to measure the 
importance of values. Respondents were asked to rate each of the 
eight values—we combined fun, enjoyment, and excitement into 
one value—on a 7-point numerical scale with end points labeled 
“very important” and “very unimportant.” 


Issues That Consumers Consider when Buying Luxury Automobiles 


Having a luxury car is a major part of my fun and excitement. (Issue 1) 
Owning a luxury car is a part of “being good to myself.’ (Issue 2) 


When | was able to buy my first luxury car, | felt a sense of 
accomplishment. (Issue 3) 


| enjoy giving my friends advice about luxury cars. (Issue 4) 


Getting a good deal when | buy a luxury car makes me feel better 
about myself. (Issue 5) 


| seek novelty and | am willing to try innovations in cars. (Issue 6) 
| tend to buy the same brand of the car several times in a row. (Issue 7) 
| tend to buy from the same dealer several times in a row. (Issue 8) 


| usually use sources of information such as Consumer Reports in 
deciding on a car. (Issue 9) 


| usually visit three or more dealerships before | buy a car. (Issue 10) 


| would read a brochure or watch a video about defensive driving. 
(Issue 11) 


When | buy a new luxury car, my family’s opinion is very important to 
me. (Issue 12) 


My family usually accompanies me when | am shopping for a new 
luxury car. (Issue 13) 


| usually rely upon ads and salespersons for information on cars. (Issue 14) 


| usually rely upon friends and acquaintances for information on cars. 
(Issue 15) 


When | shop for a car, it is important that the car dealer make me feel 
at ease. (Issue 16) 


Most of my friends drive luxury import cars. (Issue 17) 
Most of my friends drive luxury domestic cars. (Issue 18) 


| think celebrity endorsers in ads influence people's choices of luxury 
cars. (Issue 19) 


| would not buy a luxury car if | felt that my debt level were higher 
than usual. (Issue 20) 


a Note: Subjects’ responses were measured with 1 as “strongly agree” and 7 as “strongly disagree.” 


Car Attributes 
Attribute Code Attribute 
Comfort Comfort Low maintenance cost 
Safety Safety Reliability 
Power Power Warranty 
Speed Speed Nonpolluting 
Styling Styling High gas mileage 
Durability Durabil Speed of repairs 


Code 


Lomc 
Rely 
Warrant 
Nonpol 
Gasmle 


Repairs 
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List of Values 
Value Code Value Code 
Fun-enjoyment-excitement Fun Sense of accomplishment Accomp 
Sense of belonging Belong Warm relationship Warm 
Being well respected Respect Security Security 
Self-fulfill ment Selfful Self-respect Selfres 


The Sample 

Of the 155 respondents in the sample, 58 (37.4 percent) owned an 
American luxury car, 38 (24.5 percent) owned a European luxury 
car, and 59 (38.1 percent) owned a Japanese luxury car. The majority 
of the sample consisted of older consumers (85 percent were 35 years 
of age or above), more educated consumers (64 percent were col- 
lege graduates), and economically well-off consumers (87.2 percent 


earned $65,000 or more). 


List of Variables and Computer Codes 


|D—Identification number 


CODING 


Case Exhibit 3.4 lists the SPSS variable names and identifies codes 
for these variables. (Note that this data set is also available in 
Microsoft Excel.) 


Ace (categories are 2 = 35 years and under, 3 = 36-45 yrs, 4 = 46-55 yrs, 5 = 56-65 yrs, 6 = 65+ yrs) 


Sex (1 = male, 0 = female) 


Epuc—Education (1 = less than high school, 2 = high school grad, 3 = some college, 4 = college grad, 5 = graduate degree) 
Income (1 = less than $35,000, 2 = $35-50,000, 3 = $50,001-65,000, 4 = $65,001+) 


Car—Type of luxury car (American car, European car, Japanese car) 


Issues—The sequence of issues listed in Case Exhibit 4.1. (Strongly agree = 1; strongly disagree = 7) 


Atrrisutes—The sequence of car attributes listed in Case Exhibit 4.2. (Very important to you = 1; very unimportant to you = 7) 


Vatues—The sequence of values listed in Case Exhibit 4.3. (Very important = 1; very unimportant = 7) 


ADDITIONAL INFORMATION 


Several of the questions will require the use of a computerized data- 
base. Your instructor will provide information about obtaining the 
VALUES data set if the material is part of the case assignment. 


Questions 

1. Is the sampling method adequate? Is the attitude-measuring scale 
sound? Explain. 

2. Using the computerized database with a statistical software pack- 
age, calculate the means of the three automotive groups for the 


values variables. Do any of the values variables show significant 
differences between American, Japanese, and European car 
owners? 
3. Are there any significant differences on importance of attributes? 
4. Write a short statement interpreting the results of this research. 


Advanced Questions 
5. Are any of the value scale items highly correlated? 
6. Should multivariate analysis be used to understand the data? 


Case materials based on research by Ajay Sukhdial and Goutam Chakraborty, Oklahoma State University. 


Case 4 TABH, INC., Automotive Consulting 


(Download the data sets for this case from www.cengage.com/ 
marketing/zikmund or request them from your instructor.) TABH 
Consulting specializes in research for automobile dealers in the 
United States, Canada, Mexico, and Europe. Although much of 
their work is done on a custom basis with customers such as dealer- 
ships and dealership networks selling all major makes of automobiles, 
they also produce a monthly “white paper” that is sold via their 
Web site. This off-the-shelf research is purchased by other research 
firms and by companies within the auto industry itself. This month, 
they would like to produce a white paper analyzing the viability of 


college students attending schools located in small college towns as a 
potentially underserved market segment. 

TABH management assigns a junior analyst named Michel 
Gonzalez to the project. Lacking time for a more comprehensive 
study, Michel decides to contact the traffic department at Cal Poly 
University in Pomona, California, and at University of Central Mis- 
souri in Warrensburg, Missouri. Michel wishes to obtain data from 
the students’ automobile parking registration records. Although both 
schools are willing to provide anonymous data records for a limited 
number of students, Cal Poly offers Michel a chance to visit during 
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the registration period, which just happens to be the following week. 
As a result, not only can Michel get data from students’ registration 
forms, but she can obtain a small amount of primary data by inter- 
cepting students near the registration window. In return, Michel is 
asked to purchase a booth at the Cal Poly career fair. 
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As a result, Michel obtains some basic information from stu- 
dents. The information results in a small data set consisting of the 
following observations for 100 undergraduate college students in 
Pomona, California: 


Variable Description 

Sex Student's sex dummy coded with 1 = female and 0 = male 

Color Color of a student's car as listed on the registration form 

Major Student's major field of study (Business, Liberal Arts (LA), or Engineering (ENG)) 

Grade Student's grade record reported as the mode (A, B, or C) 

Finance Whether the student financed the registered car or paid for it with cash, coded 0 = cash payment and 1 = financed 
Residence Whether the student lives on campus or commutes to school, coded 0 = commute and 1 = on campus 

Animal 


Michel asks each student to quickly draw a cartoon about the type of car they would like to purchase. Students are told to depict 


the car as an animal in the cartoon. Although Michel expects to interpret these cartoons more deeply when time allows, the initial 
coding specifies what type of animal was drawn by each respondent. When Michel was unsure of what animal was drawn, a second 
researcher was conferred with to determine what animal was depicted. Some students depicted the car as a dog, some as a cat, and 


some as a mule. 


The purpose of the white paper is to offer car dealers considering 

new locations a comparison of the profile of a small town university 
with the primary market segments for their particular automobile. For 
instance, a company specializing in small pickup trucks appeals to a dif- 
ferent market segment than does a company specializing in two-door 
economy sedans. Many small towns currently do not have dealerships, 
particularly beyond the “Big 3.” Although TABH cannot predict with 
certainty who may purchase the white paper, it particularly wants to 
appeal to companies with high sales growth in the United States, such as 
Kia (http://www.kia.com), Hyundai (http://www.hyundai-motor.com), and 
potentially European auto dealerships currently without significant U.S. 
distribution, such as Smart (http://www.smart.com), among others. TABH 
also hopes the white paper may eventually lead to a customized project 
for one of these companies. Thus, the general research question is: 


What are the automobile market segment characteristics of students attending 
U.S. universities in small towns? 


This question can be broken down into a series of more specific 
questions: 


e What segments can be identified based on identifiable character- 
istics of students? 


e How do different segments view a car? 
e What types of automobiles would be most in demand? 


Questions: 


1. What types of tests can be performed using the data that may at 
least indirectly address the primary research question? 

2. What do you think the primary conclusions of the white paper 
will be based on the data provided? 

3. Assuming a small college town lacked an auto dealership 
(beyond Ford, GM, and Chrysler), what two companies should 
be most interested in this type of location? Use the Internet 
if necessary to perform some cursory research on different car 
companies. 

4. What are the weaknesses in basing decisions on this type of 
research? 

5. Are there key issues that may diminish the usefulness of this 
research? 

6. What kinds of themes might emerge from the cartoon drawings? 

7. Are there any ethical dilemmas presented in this case? 


Case 5 The Atlanta Braves 


A visit to Turner Field, the Atlanta Braves’ state-of-the-art ballpark, 
feels like a trip back to the future. The stadium blends 1940s 
tradition with 21st century convenience. The Braves’ marketing 
campaign reflects the charm and nostalgia of baseball’s past, but it 
has a futuristic slogan: “Turner Field: Not just baseball. A baseball 
theme park.” 

Fans love the fact that they’re closer to the action at Turner 
Field. It’s only 45 feet from either first or third base to the dugouts, 
with the stands just behind. Besides that, there’s a Braves Museum 
and Hall of Fame with more than 200 artifacts. Cybernauts will 
find Turner Field awesome because it’s a ballpark that makes them 
a part of the action. At the stadium, built originally for the 1996 
Olympics and converted for baseball after the Games, there are 
interactive games to test fans’ hitting and pitching skills, and their 
knowledge of baseball trivia; electronic kiosks with touch screens 


and data banks filled with scouting reports on 300 past and present 
Braves, along with the Braves’ Internet home page; a dozen 27-inch 
television monitors mounted above the Braves’ Clubhouse Store, 
broadcasting all the other major league games in progress, with a 
video ticker-tape screen underneath spitting out up-to-the-minute 
scores and stats; a sophisticated communications system, with four 
miles of fiber-optic cable underneath the playing field that will allow 
World Series games to be simulcast around the globe, as well as spe- 
cial black boxes placed throughout the stadium to allow as many as 
5,500 cell-phone calls an hour. 

The marketing of Turner Field is aimed at many types of fans. It 
is not enough just to provide nine innings of baseball. 

Turner Field’s theme-park concept was the brainchild of 
Braves President Stan Kasten. In the early 1990s, as the Braves grew 
into one of the best teams in baseball, Kasten increasingly became 
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frustrated while watching fans flock to Atlanta-Fulton County Sta- 
dium a few hours before games, with little to do but eat overcooked 
hot dogs and watch batting practice. 

As Kasten saw it, they spent too much time milling on the 
club-level concourse and too little time spending money. What if 
he could find a way for families to make an outing of it, bring the 
amenities of the city to Hank Aaron Drive, and create a neighbor- 
hood feel in a main plaza at the ballpark? “I wanted to broaden fans’ 
experience at the ballpark and broaden our fan base,” Kasten says. 
“People have no problem spending money when they’re getting 
value. We have one of the highest payrolls in baseball, and I needed 
to find new ways to sustain our revenues.” 

Turner Field’s main entry plaza opens three hours before 
games—compared to two hours for the rest of the ballpark—and 
stays open for about two hours after games. On weekends, there is 
live music. 

Everyone’s invited—186 $1 “skyline seats” are available for 
each game—and that buck gets you anywhere, from the open-air 
porch at the Chop House restaurant (which specializes in barbecue, 
bison dogs, Moon Pies, and Tomahawk lager) to the grassy roof at 
Coke’s Sky Field, where fans can keep cool under a mist machine. 

Interactive games in Scouts Alley range from $1 to $4, and the 
chroma-key studios in the East and West Pavilions cost $10—20, where 
fans can have their picture inserted into a baseball card or into a photo 
of a great moment in Braves history. Admission to the museum is $2. 
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And it should come as no surprise that there are seven ATMs located 
throughout the ballpark. 

One of the Braves’ key marketing objectives is to help build a 
new generation of baseball fans. The stadium was planned so that 
fans will find something to love and learn at every turn. The minute 
a fan’s ticket is torn, that person becomes part of what’s happening 
at Turner Field. 


Questions: 


1. What are the key elements of the Turner Field marketing effort? 
What aspect of the planning of Turner Field, home of the 
Atlanta Braves, may have been influenced by research using 
secondary data? 

3. What role should business research play in a sporting organiza- 
tion such as the Atlanta Braves, both in making capital decisions 
and in supporting everyday operational maters? 

4. Suppose an executive for the Braves wishes to know whether 
the stadium has caused employees (including ticket takers, 
parking attendants, ushers, security personnel, team employees, 
etc.) to be more committed to the Braves organization than 
they were playing in an old-fashioned stadium. What would a 
potential research design involve and what data collection and 
statistical tests, if any, could be useful? 


Statistical Tables 


TABLE A.1 Random Digits 


37751 
50915 
99142 
70720 
18460 


65763 
83769 
58900 
54746 
56819 


34990 
02269 
43042 
92565 
67424 


04015 
85226 
03360 
72460 
66960 


14824 
34001 
77718 
60930 
94180 


81073 
18467 
60643 
78372 
18395 


07261 
61679 
11815 
99007 
06446 


04998 
64152 
35021 
10033 
64947 


41133 
52570 
78420 
71115 
27340 


62122 
22795 
53600 
12211 
32620 


77148 
19763 
07457 
99682 
55780 


95631 
05618 
83830 
05091 
62151 


85543 
39689 
59399 
61697 
18482 


28720 
81529 
48679 
35050 
65608 


66038 
82981 
01032 
25191 
32958 


60950 
60133 
98579 
78219 
07200 


38223 
87593 
45738 
06868 
60841 


09535 
46105 
zai 
27970 
71778 


00697 
41900 
29781 
35726 
08112 


47650 
60801 
79740 
85728 
83245 


71244 
83725 
00556 
86440 
79291 


63480 
15796 
57907 
62358 
08752 


35372 
25211 
33665 
64314 
52663 


28526 
81830 
00261 
87786 
86848 


10743 
25289 
41209 
25632 
52629 


65462 
23303 
72917 
07414 
26646 


93830 
46828 
17295 
90779 
54942 


05064 
33269 
96871 
44280 
16624 


98442 
27102 
80545 
03784 
96366 


06782 
87384 
10718 
W227 
57864 


37006 
95383 
31100 
59576 
85000 


97871 
26714 
50451 
34096 
51692 


24815 
19928 
10840 
49211 
07617 


07377 
38670 
50094 
13235 
51905 


84873 
45958 
39835 
20320 
06135 


22245 
71635 
54112 
74377 
89092 


81451 
90182 
39342 
41702 
85159 


22774 
67823 
67239 
61382 
04835 


55919 
73253 
23472 
17656 
71442 


13930 
60755 
74182 
69586 
42954 


87995 
88243 
66436 
83114 
09534 


68020 
74265 
83055 
97527 
30622 


83538 
34470 
15150 
88150 
23597 


78764 
84990 
46346 
54517 
15460 


46026 
20196 
02004 
33972 
48576 


45274 
85922 
07438 
12736 
36130 


02938 
61404 
08293 
20226 
22521 


35084 
89042 
92677 
70728 
70839 


39037 
87460 
84949 
28138 
56133 


62351 
13608 
36856 
25567 
74308 


52645 
26400 
14401 
87676 
97564 


15981 
54850 
70698 
13161 
33884 


38304 
21785 
08375 
27476 
70425 


54619 
56947 
62588 
08274 
09395 


39386 
78452 
68345 
32093 
91073 


68981 
60525 
11681 
01088 
33998 


74514 
26360 
03247 
87457 
00881 


19841 
39128 
13503 
14078 
29637 


87291 
46779 
53597 
47208 
10101 


93125 
42624 
2931/2. 
21938 
39874 


28909 
91441 
99625 
28167 
43561 


93141 
08032 
24025 
74306 
42193 


00670 
42539 
51687 
49037 
32308 


90497 
76285 
40392 
49512 
88976 


50083 
97043 
46525 
45317 
27742 


56946 
64519 
62617 
96604 
84129 


91847 
92741 
62264 
67305 
62035 


53950 
19299 
22088 
65279 
45692 


88309 
72566 
36489 
08325 
81199 


86291 
25605 
55896 
85430 
29434 


A Million Random Digits with 100,000 Normal Deviates. Copyright 1955 by Rand Corporation. Reproduced with permission of Rand Corporation 


in the format Textbook via Copyright Clearance Center. 
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TABLE A.2 Area Under the Normal Curve 


0.0 .0000 .0040 .0080 0120 .0160 .0199 0239 0279 0319 0359 
0.1 0398 0438 0478 0517 0557 .0596 0636 0675 0714 10753 
0.2 0793 0832 0871 0910 0948 .0987 1026 1064 -1103 1141 
0.3 all 7/2) T217 1255 1293 1331 1368 1406 1443 -1480 USI 
0.4 11554 mol 1628 1664 1700 -1736 1772 .1808 .1844 .1879 
0.5 1915 -1950 1985 2019 .2054 .2088 21253 2157 .2190 2224 
0.6 2257 2291 .2324 2357 .2389 .2422 .2454 .2486 .2518 .2549 
0.7 2580 2612 .2642 .2673 .2704 .2734 .2764 .2794 .2823 2852 
0.8 2881 2910 2939 2967 2995 -3023 .3051 .3078 .3106 2133 
0.9 3159 3186 S212 3238 .3264 3289 2315 .3340 .3365 3389 
1.0 3413 3438 3461 3485 3508 3531 3554 B577 3599; .3621 
ei 3643 3665 .3686 3708 3729 3749 3770 3790 3810 3830 
12 3849 3869 3888 3907 3925 3944 3962 3980 3997 4015 
1.3 4032 4049 4066 4082 4099 115 4131 4147 4162 4177 
14 4192 4207 4222 4236 4251 4265 4279 4292 4306 4319 
iiS 4332 4345 4357 4370 4382 4394 4406 4418 4429 4441 
1.6 4452 4463 4474 4484 4495 4505 4515 4525 4535 4545 
Iz 4554 4564 4573 4582 4591 4599 4608 4616 4625 4633 
1.8 4641 4649 4656 4664 4671 4678 4686 4693 4699 4706 
iE) 4713 A719 4726 4732 4738 4744 4750 4756 4761 4767 
2.0 4772 4778 4783 4788 4793 4798 4803 4808 4812 4817 
2.1 4821 4826 4830 4834 4838 4842 4846 4850 4854 4857 
2.2 4861 4864 4868 4871 4875 4878 4881 4884 4887 4890 
23 4893 4896 4898 4901 4904 4906 4909 4911 4913 4916 
2.4 4918 4920 4922 4925 4927 4929 4931 4932 4934 4936 
2.5 4938 4940 4941 4943 4945 4946 4948 4949 4951 4952 
2.6 4953 4955 4956 4957 4959 4960 4961 4962 4963 4964 
27 4965 4966 4967 4968 4969 4970 4971 4972 4973 4974 
2.8 4974 975 4976 4977 4977 4978 4979 4979 4980 4981 
2.9 4981 4982 4982 4983 4984 4984 4985 4985 4986 4986 
3.0 49865 4987 4987 4988 4988 4989 4989 4989 4990 4990 
4.0 49997 


Kim, Chaiho, Statistical Analysis for Induction and Decision. Copyright © 1973 by The Dryden Press, a division of Holt, Rinehart and Winston, 
Inc. Reprinted with permission of Holt, Rinehart and Winston. 
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TABLE A.3 Distribution of t for Given Probability Levels 


Level of Significance for One-Tailed Test 


-025 01 


Level of Significance for Two-Tailed Test 


05 02 

1 3.078 6.314 12.706 31.821 63.657 636.619 
2 1.886 2.920 4.303 6.965 9.925 31.598 
2 1.638 255) 3.182 4.541 5.841 12.941 
4 11253338) 2.132 2.776 3.747 4.604 8.610 
5 1.476 2.015 2.571 3.365 4.032 6.859 
6 1.440 1.943 2.447 3.143 3.707 5.959) 
7 1.415 1.895 2.365 2.998 3.499 5.405 
8 1.397 1.860 2.306 2.896 3:355 5.041 
9 1.383 1.833 2.262 2.821 3.250 4.781 
10 1.372 1.812 2.228 2.764 3.169 4.587 
11 1.363 1.796 2.201 2.718 3.106 4.437 
12 1.356 1.782 2.179 2.681 3.055 4.318 
133 1.350 TA 2.160 2.650 3.012 4.221 
14 1.345 1.761 2.145 2.624 29 4.140 
15 1.341 753) A513) 2.602 2.947 4.073 
16 1337 1.746 2.120 2.583 2-921 4.015 
17 1.333 1.740 2.110 2.567 2.898 3.965 
18 17330. 1.734 2.101 2.552 2.878 31922. 
19 1.328 1.729 2.093 2.539 2.861 3.883 
20 1325 1:725; 2.086 2.528 2.845 3.850 
21 123 1.721 2.080 2.518 2.831 3.819 
22 1321 T7 2.074 2.508 2.819 3792 
23 1E3119. 1.714 2.069 2.500 2.807 3.767 
24 1.318 1.711 2.064 2.492 ZIM 3.745 
25 1.316 1.708 2.060 2.485 2.787 51725 
26 1:315 1.706 2.056 2.479 2.779 3.707 
27 1.314 1.703 2.052 2.473 27 3.690 
28 1.313 1.701 2.048 2.467 2.763 3.674 
29 1.311 1.699 2.045 2.462 2.756 3.659 
30 1.310 1.697 2.042 2.457 2.750 3.646 
40 1.303 1.684 2.021 2.423 2.704 355l 
60 1.296 1.671 2.000 2.390 2.660 3.460 
120 1.289 1.658 1.980 2.358 2.617 3.373, 


o0 1.282 1.645 1.960 2.326 2.576 B291 
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TABLE A.4 Chi-Square Distribution 


Degrees of Freedom 
(df) 


Area in Shaded Right Tail (a) 


-10 


2.706 
4.605 
6.251 
UUT) 
9236 


10.645 
12.017 
13.362 
14.684 
15.987 


17275 
18.549 
19.812 
21.064 
22.307 


23.542 
24.769 
25.989 
27.204 
28.412 


29.615 
30.813 
32.007 
33.196 
34.382 


35.563 
36.741 
37.916 
39.087 
40.256 


-05 


3.841 
5.991 
7.815 
9.488 
11.070 


12.592 
14.067 
15.507 
16.919 
18.307 


19.675 
21.026 
22.362 
23.685 
24.996 


26.296 
27.587 
28.869 
30.144 
31.410 


32.671 
33.924 
35.172 
36.415 
37.652 


38.885 
40.113 
41.337 
42.557 
43.773 


01 


6.635 
9.210 
11.345 
13.277 
15.086 


16.812 
18.475 
20.090 
21.666 
23.209 


24.725 
26.217 
27.688 
29.141 
30.578 


32.000 
33.409 
34.805 
36.191 
37.566 


38.932 
40.289 
41.638 
42.980 
44.314 


45.642 
46.963 
48.278 
49.588 
50.892 


Statistical Tables 


Example of how to use this table: In a chi-square distribution with 6 degrees of freedom (df), the area to the right of a critical value of 12.592—i.e,, the a 


area—is .05. 
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TABLE A.5 Critical Values of F, | for a = .05 


v, = Degrees of Freedom for Numerator 


7 8 9 10 12 15 


161 200 216 225 230 234 237 239 241 242 244 246 248 249 250 251 252 253 254 
135 Te) 12 2 Ws 1s lee lew lew ew ew el ies Is ee; 1s eis TES 165 
WO] S55 CPt} Chl Coil Gehl eee) BES Geol Ae) GA shy) BUSS BHS Gey) GS) EES GD GSS) 
TIM OR Cs Os) 62) ilo 60) @04 600 586 SY As S80 S7// SYD BV2 SE) Sh SOS 
661 5.79 5.41 5.19 5.05 495 488 482 4.77 474 468 462 456 453 450 446 443 440 4.37 


ukhWN = 


5.99 5.14 476 453 439 428 421 4.15 4.10 406 4.00 3.94 387 3.84 3.81 3.77 3.74 3.70 3.67 
ys) Garay cei) Vib) SHe/SHSV/ SAS) Bh 7/8) Sets} SSE SiG y/ Sheil BAM Sei] | Shsts}  BYSY  Shs0) S27! 708) 
DER LG LRA SE SE SYS} SA SHAME eee SSS SPN) SY) BEI) SR SHON} SOM) SKO ZA eI} 
BZ aAA BUNS SOs} SAS) S SPAS) Shs} SIG} Shee SH Su Ae A AA ABE AIEE AUD l 
O26 O saa S Sse SAA SIUE SRA S0 ASR A AS AI D LO A A N l 


wo ON A 


Wil ARa sites) ashe) isis; SO SWP ail «= Ay eT) AED A Ae PHS) POI) A ADS AE Uy, PEN) 
ex byl) Sse) Siley ahs) shill © SHON) AL ESI ASO) A/S) ASE) AAs) sy) pi] a avis} ists} alsyal 20 8X0) 
Uey Agor S SE SME SOE AEP 2E AI DIA RIE A RAA AA 2142 PAE Sa SO 2.2 D224 
14160m 74A Sil] «= ARs) PES) 76270265260 AS} ANS he) sy PSI) APY aaa 
Ua Aa SOG SEA SS Aew 07,9 2 A 2s A L ae, 1 OED: 5 3222.2 2 a A 207, 


16 449 3.63 3.24 3.01 2.85 2.74 2.66 259 254 249 242 235 2.28 224 219 215 2.11 2.06 2.01 
te, AAS SE By Po) AES PEGI] PAAR) PAGS) AS A) AS SIL es} ALI) ALIS ARID) ASO) KS} 
Ui} GAN] SS) SIG ZEB AA PS) EE) RS) NGS). eI) hil AE) AS lee 
Ue) ASR SEA shih AEO AA uss) ays ails} ivi) esx) AS A23 2e AI) PAY OES} eS HS) 
200435349 m1027 2,7) le. Oe 2, oil 2.4 e239 223.52, 2 0 e202 O21 22,0 Se? 04 een OO Ra Oo OO MAILS: 


Pui) Ges) Shy! SHOE E AI PL A A P EP PPI) PAIN) EIN) PHOS PAO dS) M SHI 
22 430 344 3.05 282 266 255 246 240 234 230 223 215 207 203 198 1.94 189 1.84 1.78 
2304293 SHO} aStO) AAS as) A S7 Psy PP) PPA) ALi} AA PAT SEN as) eS alas) 
244269 3:40 53-0278 2.02 52 ol 2.42 2 362 S02 2527 S223 1989439 847 7 
24 24 S39 2.9927 Cee 2, OO 2.492 402.3 422 S224 e212 O92: 011 OG 2 17. S277 71 


v, = Degrees of Freedom for Denominator 


eli) bil SISPA PeP 2A as) AA arse) eh PL PRI o P eE EE sb eek) iets) de 
40 408 3.23 284 261 245 234 225 218 212 2.08 2.00 1.92 1.84 1.79 1.74 1.69 1.64 1.58 1.51 
Gy 400) SI AS ASS A PB) PEI PEI) OE) er A) dss ee) Es} tl) 
et) SER SMO AI ail) AA Lis} 20) AO ls uss} Ls Se) SSS) 
EI SR SKUO ZAO sii AAP) PRIMO) PAO dese} sis) lga a i’) Li) se) ee 27) efoto) 


Merrington, Maxine and Thompson, Catherine M. “Tables of the Percentage Points of the Inverted F-Distribution,” Biometrica, Vol. 33, 1943, 
pp. 73-78. Reprinted with the permission of Biometrica Trustees. 
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TABLE A.6 Critical Values of F, „ for a = .01 


v, = Degrees of Freedom for Numerator 


7 8 9 10 12 15 20 24 30 40 


1 4,052 5,000 5,403 5,625 5,764 5,859 5,928 5,982 6,023 6,056 6,106 6,157 6,209 6,235 6,261 6,287 6,313 6,339 6,366 
2) Os EO) bez Cele wes) Ces Got weil Cea Cet Cer wet Cov os 5 Les es eis Wes 
Ei Sybil SWE | 2) AIU AIA PIS Pe PTB) PA PP || ADE) ADT AHI AD ADA ANS) AD) AS) 
4 212 180 167 160 155 15.22 150 148 147 145 144 142 140 13.9 138 13.7 13.7 13.6 13.5 
| Wes sks) U2 Wilh We) il ess} GL) she) eye Ss) Our PEE SA SA Oli) = Co 
6 
7 
8 
9 


siz OS) Oye) Chis Gh GM th EI EIS S/S OS) STI 976.838 
PA OSs CHO UEA TAA AIC CE) GLA ye Gey GA (stil GIS G ee) Beil SEY AA SOS 
Ws BS Se O a a Ae o Sl SE S SeA DSO SRi SA D E ALD AS 
10.6 802 6.99 642 606 5.80 561 547 5.35 5.26 5.11 496 4.81 4.73 465 457 448 440 4.31 
10 10.0 756 655 599 564 5.39 520 506 494 485 4.71 456 441 433 425 417 408 4.00 3.91 


11 9.65 7.21 622 567 532 5.07 489 474 463 454 440 425 410 402 3.94 3.86 3.78 3.69 3.60 
12 9.33 693 595 541 506 4.82 464 450 439 430 4.16 401 386 3.78 3.70 3.62 3.54 345 3.36 
13° (9.07 670 5.74 5.21 486 462 444 430 4.19 410 3.96 382 3.66 3.59 3.51 343 3.34 3.25 3.17 
14 886 651 5.56 5.04 470 446 428 4.14 4.03 3.94 3.80 366 3.51 343 3.35 3.27 3.18 3.09 3.00 
ie) Hef} (est) Sut) sie) eyo) bs EE NOLO) SHSIe)  SMSIO) BMG/ SY) Sh s7/ BPAY SI 72) ShIIS} BHO AIS AUESHY/ 


16 853 623 5.29 477 444 4.20 403 3.89 3.78 369 3.55 341 3.26 3.18 3.10 3.02 2.93 284 2.75 
172 S:4. 0G) ieee ot Ol 467,434 4 OS 93S, 190 5-083. 59 sees 40m 63000292233 275265 
UG} Ae) GOL Suge) Aes) ay MOT aie! SA SO © Shi) S Shes} Bhs} MO) APD SYN ATS) AA AS 
Ue) Ge Se} Soil A Abily’ SSA SIAO SEE SSR evils} SS SD SKOON AEP ants DIA AS) ABS) AA) 
20e 1005359410770566 a372 SHOE) SE Pfs) 78 PASS) PASI] PAYA AD 


21 802 5.78 487 437 404 381 364 3.51 340 3.31 3.17 3.03 288 280 272 264 255 246 2.36 
ee) Tits SA ARR Ae BSE) SIO BS) SKS SSI) SABI AE} AEE PATS) PHI AA A AAO) SI 
pkey T/as}3) BSI Asya EE SYAl sheyeh Sibi Si Si0) Shai) sMOyy/ As) AS} PATA) Poy) Pisyih adil) Sis) PLAS) 
247-82 eo Olin 72 42290 eS: O/ eS: OS. ONS: 20mm Se S.O 52-0902: 42. OOM 2D O6uE2.49 Ne 402 Sle? 211 
P U DS GMs} ARs) BEO Sos) Sda Shs) Bi) hls} ZAEE 2D A A plans} AA Pasta) A PLANT 


v, = Degrees of Freedom for Denominator 


E ASe SE Gi] AOPA SAU SMA SEU SHA SO Ae a ZA NS) AT PEE O AA l Ao 
CX) ge Se GES) Su Siol SA) SE Ae A O AN) A A N A AL AO ER I 
G L ACE CuS S seh SLIZ 20D DAA AA PAO 2A SS A 2 AE MEA gai UFE AO 
MA GES AIA SOD ELE ELU 2A A AA A A e AO A0 MES Wea a Mea Ss) 1AE 
663 A678 S327302 2302642522 087 705720 


Merrington, Maxine and Thompson, Catherine M. “Tables of the Percentage Points of the Inverted F-Distribution,” Biometrica, Vol. 33, 1943, 
pp. 73-78. Reprinted with the permission of Biometrica Trustees. 
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TABLE A.7 Critical Values of the Pearson Correlation Coefficient 


Level of Significance for One-Tailed Test 


-025 -01 


Level of Significance for Two-Tailed Test 


-02 
1 .988 997 9995 9999 
2 900 -950 .980 .990 
3 805 878 934 259] 
4 729 811 882 Bi 
5 669 154 833 874 
6 622 107 789 834 
7 582 .666 750 198 
8 549 632 716 765 
9 521 602 685 735 
10 497 576 658 108 
11 576 593 .634 .684 
12 458 532 612 661 
13 A41 514 592 .641 
14 426 497 574 623 
15 412 482 558 606 
16 400 468 542 590 
17 .389 456 528 S7 
18 378 444 516 561 
19 369 433 503 549 
20 360 423 492 537 
21 352 413 A482 526 
22 344 404 A472 55 
23 337 396 462 505 
24 230 388 .453 .496 
25 323 381 .445 .487 
26 317 374 .437 479 
27. 311 367 430 71 
28 306 361 423 463 
29 301 355 .416 486 
30 296 349 .409 449 
35 27D) 325 381 418 
40 257 304 358 293 
45 .243 288 338 2. 
50 231 273 B22 354 
60 211 250 293 B25 
70 195 232 274 303 
80 183 PAY 256 283 
90 178 205 .242 "267 


100 .164 195 230 254 
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TABLE A.8 Critical Values of Tin the Wilcoxon Matched-Pairs Signed-Ranks Test 


Level of Significance for Two-Tailed Test 


-02 


12 14 10 7 
13 17 13 10 
14 21 16 J5 
15 25 20 16 
16 30 24 19 
17 35 28 23 
18 40 33 28 
19 46 38 32 
20 52 43 37 
21 39 49 43 
22 66 56 49 
23 73 62 55 
24 81 69 61 
25 90 Wi 68 


Adapted from Table 2 of Frank Wilcoxon and Roberta A. Wilcoxon, Some Rapid Approximate Statistical Procedures (New York: American Cynamid 
Company, 1964), p. 28. 


Glossary of Frequently Used Symbols 


Greek Letters 

level of significance or probability of a Type I error 
probability of a Type II error or slope of the regression line 
population mean 

population Pearson correlation coefficient 

take the sum of 

population proportion 

population standard deviation 


chi-square statistic 


English Letters 

number of degrees of freedom 

F-statistic 

sample size 

sample proportion 

probability of the outcome in the parentheses 

sample Pearson correlation coefficient 

coefficient of determination (squared correlation coefficient) 
coefficient of determination (multiple regression) 

sample standard deviation (inferential statistics) 

estimated standard error of the mean 

estimated standard error of the proportion 

sample variance (inferential statistics) 

t-statistic 

variable or any unspecified observation 

sample mean 

any unspecified observation on a second variable, usually the dependent variable 
predicted dependent variable score 


standardized score (descriptive statistics) or Z-statistic 


647 


absolute causality Means the cause is necessary and sufficient to 
bring about the effect. 

abstract level In theory development, the level of knowledge 
expressing a concept that exists only as an idea or a quality apart 
from an object. 

acquiescence bias A tendency for respondents to agree with all or 
most questions asked of them in a survey. 

administrative error An error caused by the improper adminis- 
tration or execution of the research task. 

advocacy research Research undertaken to support a specific claim 
in a legal action or represent some advocacy group. 

analysis of variance (ANOVA) Analysis involving the investi- 
gation of the effects of one treatment variable on an interval- 
scaled dependent variable—a hypothesis-testing technique to 
determine whether statistically significant differences in means 
occur between two or more groups. 

applied business research Research conducted to address a spe- 
cific business decision for a specific firm or organization. 

attitude An enduring disposition to consistently respond in a given 
manner to various aspects of the world, composed of affective, 
cognitive, and behavioral components. 

attribute A single characteristic or fundamental feature of an 
object, person, situation, or issue. 


back translation Taking a questionnaire that has previously been 
translated into another language and having a second, indepen- 
dent translator translate it back to the original language. 

backward linkage Implies that later steps influence earlier stages 
of the research process. 

balanced rating scale A fixed-alternative rating scale with an 
equal number of positive and negative categories; a neutral 
point or point of indifference is at the center of the scale. 

basic business research Research conducted without a specific 
decision in mind and that usually does not address the needs of a 
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specific organization. It attempts to expand the limits of knowl- 


edge in general and is not aimed at solving a particular prag- 
matic problem. 

basic experimental design An experimental design in which 
only one variable is manipulated. 

behavioral differential A rating scale instrument similar to a 
semantic differential, developed to measure the behavioral 
intentions of subjects toward future actions. 

between-groups variance The sum of differences between the 
group mean and the grand mean summed over all groups for a 
given set of observations. 

between-subjects design Each subject in an experiment receives 
only one treatment combination. 

bivariate statistical analysis Statistical test involving two 
variables. 

blocking variables A categorical (less-than interval) variable that 
is not manipulated as is an experimental variable but is included 
in the statistical analysis of experiments 

box and whisker plots Graphic representations of central ten- 
dencies, percentiles, variabilities, and the shapes of frequency 
distributions. 

briefing session A training session to ensure that each interviewer 
is provided with common information. 

business ethics The application of morals to behavior related to 
the exchange environment. 

business intelligence The subset of data and information that 
actually has some explanatory power enabling effective decisions 
to be made. 

business opportunity A situation that makes some potential com- 
petitive advantage possible. 

business problem A situation that makes some significant nega- 
tive consequence more likely. 

business research The application of the scientific method in 
searching for the truth about business phenomena. These 
activities include defining business opportunities and problems, 
generating and evaluating ideas, monitoring performance, and 
understanding the business process. 


Glossary 


callbacks Attempts to recontact individuals selected for a sample 
who were not available initially. 

case study The documented history of a particular person, group, 
organization, or event. 

categorical variable A variable that indicates membership in 
some group. 

category scale A rating scale that consists of several response cate- 
gories, often providing respondents with alternatives to indicate 
positions on a continuum. 

causal inference A conclusion that when one thing happens, 
another specific thing will follow. 

causal research Allows causal inferences to be made; seeks to 
identify cause-and-effect relationships. 

cell Refers to a specific treatment combination associated with an 
experimental group. 

census An investigation of all the individual elements that make up 
a population. 

central location interviewing Telephone interviews conducted 
from a central location, allowing firms to hire a staff of profes- 
sional interviewers and to supervise and control the quality of 
interviewing more effectively. 

central-limit theorem The theory that, as sample size increases, 
the distribution of sample means of size n, randomly selected, 
approaches a normal distribution. 

check boxes In an Internet questionnaire, small graphic boxes, 
next to answers, that a respondent clicks on to choose an 
answer; typically, a check mark or an X appears in the box 
when the respondent clicks on it. 

checklist question A fixed-alternative question that allows the 
respondent to provide multiple answers to a single question by 
checking off items. 

chi-square (x’) test One of the basic tests for statistical signifi- 
cance that is particularly appropriate for testing hypotheses 
about frequencies arranged in a frequency or contingency table. 

choice A measurement task that identifies preferences by requiring 
respondents to choose between two or more alternatives. 

classificatory variable Another term for a categorical variable 
because it classifies units into categories. 

click-through rate Proportion of people who are exposed to an 
Internet ad who actually click on its hyperlink to enter the 
Web site; click-through rates are generally very low. 

cluster analysis A multivariate approach for grouping observations 
based on similarity among measured variables. 

cluster sampling An economically efficient sampling technique in 
which the primary sampling unit is not the individual element 
in the population but a large cluster of elements; clusters are 
selected randomly. 

code book A book that identifies each variable in a study and 
gives the variable’s description, code name, and position in the 
data matrix. 

codes Rules for interpreting, classifying, and recording data in the 
coding process; also, the actual numerical or other character 
symbols assigned to raw data. 

coding The process of assigning a numerical score or other charac- 
ter symbol to previously edited data. 

coefficient alpha (a) The most commonly applied estimate of a 
multiple item scale’s reliability. It represents the average of all 
possible split-half reliabilities for a construct. 


649 


coefficient of determination (R’) A measure obtained by squar- 
ing the correlation coefficient; the proportion of the total vari- 
ance of a variable accounted for by another value of another 
variable. 

cohort effect A change in the dependent variable that occurs 
because members of one experimental group experienced 
different historical situations than members of other experimen- 
tal groups. 

communication process The process by which one person or 
source sends a message to an audience or receiver and then 
receives feedback about the message. 

comparative rating scale Any measure of attitudes that asks 
respondents to rate a concept in comparison with a benchmark 
explicitly used as a frame of reference. 

completely randomized design An experimental design that 
uses a random process to assign subjects to treatment levels of an 
experimental variable. 

composite measures Measurements that assign a value to an obser- 
vation based on a mathematical derivation of multiple variables. 

composite scale A way of representing a latent construct by sum- 
ming or averaging respondents’ reactions to multiple items, each 
assumed to indicate the latent construct. 

computer-assisted telephone interviewing (CATI) Technology 
that allows answers to telephone interviews to be entered 
directly into a computer for processing. 

concept A generalized idea that represents something of meaning. 

concept (or construct) A generalized idea about a class of objects 
that has been given a name; an abstraction of reality that is the 
basic unit for theory development. 

conclusions and recommendations section The part of the 
body of a report that provides opinions based on the results and 
suggestions for action. 

concomitant variation One of three criteria for causality; occurs 
when two events “covary,” meaning they vary systematically. 

conditional causality Means that a cause is necessary but not suf- 
ficient to bring about an effect. 

confidence interval estimate A specified range of numbers 
within which a population mean is expected to lie; an estimate 
of the population mean based on the knowledge that it will be 
equal to the sample mean plus or minus a small sampling error. 

confidence level The range of values for some estimate that 
accounts for a specified percentage of possibility. 

confidentiality The information involved in a research study will 
not be shared with others. 

conflict of interest A condition that occurs when one researcher 
works for two competing companies. 

confound An alternative causal explanation, beyond the intended 
experimental variable, for any observed differences in the 
dependent variable. 

constancy of conditions Subjects in all experimental groups are 
exposed to identical conditions except for the differing experi- 
mental treatments. 

constant Unchanging; this is not useful in addressing research 
questions. 

constant-sum scale A measure of attitudes in which respon- 
dents are asked to divide a constant sum to indicate the relative 
importance of attributes; respondents often sort cards, but the 
task may also be a rating task. 

construct A term used to refer to concepts measured with 
multiple variables. 
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construct validity Construct validity exists when a measure reli- 
ably and truthfully represents a unique concept; consists of sev- 
eral components including face validity, content validity, criterion 
validity, convergent validity, and discriminant validity. 

consumer panel A longitudinal survey of the same sample of 
individuals or households to record their attitudes, behavior, or 
purchasing habits over time. 

content analysis The systematic observation and quantitative 
description of the content of communication. 

content providers Parties that furnish information on the World 
Wide Web. 

content validity The degree to which a measure covers the 
breadth of the domain of interest. 

contingency table A data matrix that displays the frequency of 
some combination of possible responses to multiple variables; 
cross-tabulation results. 

continuous measures Measures that reflect the intensity of a con- 
cept by assigning values that can take on any value along some 
scale range. 

continuous variable A variable that can take on a range of values 
that correspond to some quantitative amount. 

contributory causality Means that a cause need be neither neces- 
sary nor sufficient to bring about an effect. 

contrived observation Observation in which the investigator cre- 
ates an artificial environment in order to test a hypothesis. 

control group A group of subjects to whom no experimental 
treatment is administered. 

convenience sampling The sampling procedure of obtaining 
those people or units that are most conveniently available. 

convergent validity Concepts that should be related to one 
another are in fact related; highly reliable scales contain conver- 
gent validity. 

conversations An informal qualitative data-gathering approach in 
which the researcher engages a respondent in a discussion of the 
relevant subject matter. 

cookies Small computer files that a content provider can save onto 
the computer of someone who visits its Web site. 

correlation coefficient A standardized statistical measure of 
the covariation, or association, between two at-least interval 
variables. 

correlation matrix The standard form for reporting correlation 
coefficients for more than two variables. 

correspondence rules These indicate the way that a certain value 
on a scale corresponds to some true value of a concept. 

counterbalancing Attempts to eliminate the confounding effects 
of order of presentation by requiring one-fourth of subjects to 
be exposed to treatment A first, one-fourth to treatment B first, 
one-fourth to treatment C first, and finally one-fourth to 
treatment D first. 

counterbiasing statement An introductory statement or pream- 
ble to a potentially embarrassing question that reduces a respon- 
dent’s reluctance to answer by suggesting that certain behavior 
is not unusual. 

covariance Extent to which two variables are associated systemati- 
cally with each other. 

cover letter Letter that accompanies a questionnaire to induce the 
reader to complete and return the questionnaire. 

criterion validity The ability of a measure to correlate with other 
standard measures of similar constructs or established criteria. 

critical values The values that lie exactly on the boundary of the 
region of rejection. 
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cross-checks The comparison of data from one source with data 
from another source to determine the similarity of independent 
projects. 

cross-functional teams Employee teams composed of individuals 
from various functional areas such as engineering, production, 
finance, and marketing who share a common purpose. 

cross-sectional study A study in which various segments of 
a population are sampled and data are collected at a single 
moment in time. 

cross-tabulation The appropriate technique for addressing 
research questions involving relationships among multiple less- 
than interval variables; results in a combined frequency table 
displaying one variable in rows and another in columns. 

cross-validate To verify that the empirical findings from one 
culture also exist and behave similarly in another culture. 

curb-stoning A form of interviewer cheating in which an inter- 
viewer makes up the responses instead of conducting an actual 
interview. 

custom research Research projects that are tailored specifically to 
a client’s unique needs. 

customer discovery Involves mining data to look for patterns 
identifying who is likely to be a valuable customer. 

customer relationship management (CRM) Part of the DSS 
that addresses exchanges between the firm and its customers. 


data Facts or recorded measures of certain phenomena. 

data analysis The application of reasoning to understand the data 
that have been gathered. 

data conversion The process of changing the original form of the 
data to a format suitable to achieve the research objective; also 
called data transformation. 

data entry The activity of transferring data from a research project 
to computers. 

data file The way a data set is stored electronically in spreadsheet- 
like form in which the rows represent sampling units and the 
columns represent variables. 

data integrity The notion that the data file actually contains the 
information that the researcher promised the decision maker he or 
she would obtain, meaning in part that the data have been edited 
and properly coded so that they are useful to the decision maker. 

data mining The use of powerful computers to dig through 
volumes of data to discover patterns about an organization’s 
customers and products; applies to many different forms of 
analysis. 

data quality The degree to which data represent the true 
situation. 

data reduction technique Multivariate statistical approaches that 
summarize the information from many variables into a reduced set 
of variates formed as linear combinations of measured variables. 

data transformation Process of changing the data from their 
original form to a format suitable for performing a data analysis 
addressing research objectives. 

data warehouse The multitiered computer storehouse of current 
and historical data. 

data warehousing The process allowing important day-to-day 
operational data to be stored and organized for simplified access. 

data wholesalers Companies that put together consortia of data 
sources into packages that are offered to municipal, corporate, 
and university libraries for a fee. 
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database marketing The use of customer databases to promote 
one-to-one relationships with customers and create precisely 
targeted promotions. 

database A collection of raw data, arranged logically and organized 
in a form that can be stored and processed by a computer. 

data-processing error A category of administrative error that occurs 
because of incorrect data entry, incorrect computer programming, 
or other procedural errors during data analysis. 

debriefing Procedure in which research subjects are fully informed 
and provided with a chance to ask any questions they may have 
about the experiment. 

decision making The process of developing and deciding among 
alternative ways of resolving a problem or choosing from 
among alternative opportunities. 

decision statement A written expression of the key question(s) 
that the research user wishes to answer. 

decision support system (DSS) A computer-based system that 
helps decision makers confront problems through direct interac- 
tion with databases and analytical software programs. 

deductive reasoning The logical process of deriving a conclusion 
about a specific instance based on a known general premise or 
something known to be true. 

degrees of freedom (df) The number of observations minus the 
number of constraints or assumptions needed to calculate a 
statistical term. 

deliverables The term used often in consulting to describe research 
objectives to a research client. 

demand characteristic Experimental design element or proce- 
dure that unintentionally provides subjects with hints about the 
research hypothesis. 

demand effect The result that occurs when demand characteristics 
do indeed affect the dependent variable. 

dependence techniques Multivariate statistical techniques that 
explain or predict one or more dependent variables. 

dependent variable A process outcome or a variable that is 
predicted and/or explained by other variables. 

depth interview A one-on-one interview between a professional 
researcher and a research respondent conducted about some 
relevant business or social topic. 

descriptive analysis The elementary transformation of raw data 
in a way that describes the basic characteristics such as central 
tendency, distribution, and variability. 

descriptive research A type of research that describes characteristics 
of objects, people, groups, organizations, or environments and 
tries to “paint a picture” of a given situation. 

descriptive statistics Statistics which summarize and describe the 
data in a simple and understandable manner. 

determinant-choice question A fixed-alternative question that 
requires the respondent to choose one response from among 
multiple alternatives. 

diagnostic analysis A type of analysis that seeks to diagnose reasons 
for business outcomes and focuses specifically on the beliefs and 
feelings consumers have about and toward competing products. 

dialog boxes Windows that open on a computer screen to 
prompt the user to enter information. 

direct observation A straightforward attempt to observe and 
record what naturally occurs; the investigator does not create an 
artificial situation. 

discrete measures Measures that take on only one of a finite 
number of values. 
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discriminant analysis A statistical technique for predicting the 
probability that an object will belong in one of two or more 
mutually exclusive categories (dependent variables), based on 
several independent variables. 

discriminant validity A type of validity that represents how unique 
or distinct a measure is; a scale should not correlate too highly 
with a measure of a different construct. 

discussion guide A focus group outline that includes written 
introductory comments informing the group about the focus 
group purpose and rules, and then outlines topics or questions to 
be addressed in the group session. 

disguised questions Indirect questions that assume that the purpose 
of the study must be hidden from the respondent. 

disproportional stratified sample A stratified sample in which 
the sample size for each stratum is allocated according to 
analytical considerations. 

do-not-call legislation Legal action that restricts any telemarketing 
organization from calling consumers who either register with a 
no-call list or who request not to be called. 

door-in-the-face compliance technique A two-step process 
for securing a high response rate. In step 1 an initial request, so 
large that nearly everyone refuses it, is made. Next, a second 
request is made for a smaller favor; respondents are expected to 
comply with this more reasonable request. 

door-to-door interviews Personal interviews conducted at 
respondents’ doorsteps in an effort to increase the participation 
rate in the survey. 

double-barreled question A question that may induce bias 
because it covers two issues at once. 

drop-down box In an Internet questionnaire, a space-saving 
device that reveals responses when they are needed but other- 
wise hides them from view. 

drop-off method A survey method that requires the interviewer 
to travel to the respondent’s location to drop off questionnaires 
that will be picked up later. 

dummy coding Numeric “1” or “0” coding where each 
number represents an alternate response such as “female” or 
“male.” 

dummy tables Tables placed in research proposals that are exact 
representations of the actual tables that will show results in the 
final report with the exception that the results are hypothetical 
(fictitious). 

dummy variable The way a dichotomous (two group) indepen- 
dent variable is represented in regression analysis by assigning 
a 0 to one group and a 1 to the other. 


editing The process of checking the completeness, consistency, 
and legibility of data and making the data ready for coding and 
transfer to storage. 

elaboration analysis An analysis of the basic cross—tabulation 
for each level of a variable not previously considered, such as 
subgroups of the sample. 

electronic data interchange (EDI) A type of exchange that 
occurs when one company’s computer system is integrated with 
another company’s system. 

e-mail surveys Surveys distributed through electronic mail. 

empirical level A level of knowledge that is verifiable by experi- 
ence or observation. 
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empirical testing Examining a research hypothesis against reality 
using data. 

environmental scanning A research method that entails all 
information gathering designed to detect changes in the external 
operating environment of the firm. 

error trapping The use of software to control the flow of an 
Internet questionnaire—for example, to prevent respondents from 
returning to previous questions or failing to answer a question. 

ethical dilemma A situation in which one chooses form alterna- 
tive courses of actions, each with different ethical implications. 

ethnography The study of cultures through methods that involve 
becoming highly active within that culture. 

evaluation research The formal, objective measurement and 
appraisal of the extent to which a given activity, project, or 
program has achieved its objectives. 

experiment A carefully controlled study in which the researcher 
manipulates a proposed cause and observes any corresponding 
change in the proposed effect. 

experimental condition One of the possible levels of an experi- 
mental variable manipulation. 

experimental group A group of subjects to whom an experimen- 
tal treatment is administered. 

experimental treatment The term referring to the way an exper- 
imental variable is manipulated. 

experimental variable The proposed cause, controlled by the 
researcher who manipulates it. 

exploratory research A type of research conducted to clarify 
ambiguous situations or discover ideas that may be potential 
business opportunities. 

external data Data created, recorded, or generated by an entity 
other than the researcher’s organization. 

external validity The accuracy with which experimental results 
can be generalized beyond the experimental subjects. 

extraneous variables Variables that naturally exist in the environ- 
ment and that may have some systematic effect on the depen- 
dent variable. 

extremity bias A category of response bias that results because 
some individuals tend to use extremes when responding to 
questions. 

eye-tracking monitor A mechanical device used to observe eye 
movements; some eye monitors use infrared light beams to 
measure unconscious eye movements. 


face validity A scale’s content logically appears to reflect what was 
intended to be measured. 

factor analysis A prototypical multivariate, interdependence tech- 
nique that statistically identifies a reduced number of factors 
from a larger number of measured variables. 

factor loading Indicates how strongly a measured variable is 
correlated with a factor. 

factor rotation A mathematical way of simplifying factor analysis 
results to better identify which variables “load on” which factors; 
the most common procedure is varimax. 

factorial design A design that allows for the testing of the effects of 
two or more treatments (experimental variables) at various levels. 

fax survey A survey that uses fax machines as a way for respon- 
dents to receive and return questionnaires. 

field A collection of characters that represents a single type of 
data—usually a variable. 
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field editing Preliminary editing by a field supervisor on the 
same day as the interview to catch technical omissions, check 
legibility of handwriting, and clarify responses that are logically 
or conceptually inconsistent. 

field experiments Research projects involving experimental 
manipulations that are implemented in a natural environment. 

field interviewing service A research supplier that specializes in 
gathering data. 

field notes The researcher’s descriptions of what actually hap- 
pens in the field; these notes then become the text from which 
meaning is extracted. 

fieldworker An individual who is responsible for gathering data in 
the field. 

filter question A question that screens out respondents who are 
not qualified to answer a second question. 

fixed-alternative questions Questions in which respondents are 
given specific, limited-alternative responses and asked to choose 
the one closest to their own viewpoint. 

focus blog A type of informal, “continuous” focus group estab- 
lished as an Internet blog for the purpose of collecting qualita- 
tive data from participant comments. 

focus group A small group that discusses some research 
topic, led by a moderator who guides discussion among the 
participants. 

focus group interview An unstructured, free-flowing interview 
with a small group of around six to ten people. Focus groups 
are led by a trained moderator who follows a flexible format 
encouraging dialogue among respondents. 

foot-in-the-door compliance technique A technique for obtain- 
ing a high response rate; compliance with a large or difficult task 
is induced by first obtaining the respondent’s compliance with a 
smaller request. 

forced answering software Software that prevents respondents 
from continuing with an Internet questionnaire if they fail to 
answer a question. 

forced-choice rating scale A fixed-alternative rating scale that 
requires respondents to choose one of the fixed alternatives. 

forecast analyst Employee who provides technical assistance 
such as running computer programs and manipulating data to 
generate a sales forecast. 

forward linkage A connection that implies that the earlier stages 
of the research process influence the later stages. 

free-association techniques A technique that records respon- 
dents’ first (top-of-mind) cognitive reactions to some stimulus. 

frequency distribution A set of data organized by summarizing 
the number of times a particular value of a variable occurs. 

frequency table A table displaying a frequency distribution. 

frequency-determination question A fixed-alternative 
question that asks for an answer about general frequency of 
occurrence. 

F-test A statistical test used to determine whether some outcome 
varies systematically with an independent variable(s). 

F-test (regression) A statistical test aimed at determining whether 
or not a significant amount of variance in a dependent variable 
is explained by the independent variable(s). 

funded business research A type of basic research usually 
performed by academic researchers and is financially supported 
by some public or private institution, as in federal government 
grants. 

funnel technique The technique of asking general questions 
before specific questions in order to obtain unbiased responses. 
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general linear model (GLM) A way of explaining and predicting a 
dependent variable based on fluctuations (variation) from its mean. 
The fluctuations are due to changes in independent variables. 

global information system An organized collection of computer 
hardware, software, data, and personnel designed to capture, 
store, update, manipulate, analyze, and immediately display 
information about worldwide business activity. 

goodness-of-fit (GOF) A general term representing how well 
some computed table or matrix of values matches some popula- 
tion or predetermined table or matrix of the same size. 

grand mean The mean of a variable over all observations. 

graphic aids Pictures or diagrams used to clarify complex points 
or emphasize a message. 

graphic rating scale A measure of attitude that allows respon- 
dents to rate an object by choosing any point along a graphic 
continuum. 

grounded theory An inductive investigation in which the 
researcher poses questions about information provided by 
respondents or taken from historical records; the researcher 


repeatedly questions the responses to derive deeper explanations. 


Hawthorne effect The experimental phenomenon whereby 
people will perform differently from normal when they know 

they are experimental subjects. 

hermeneutic unit A text passage from a respondent’s story that is 

linked with a key theme from within this story or provided by 

the researcher. 

hermeneutics An approach to understanding phenomenology that 

relies on analysis of texts through which a person tells a story 

about him or herself. 

hidden observation Observation in which the subject is unaware 


that observation is taking place. 

histogram A graphical way of showing a frequency distribution in 
which the height of a bar corresponds to the observed frequency 
of the category. 

history effect An effect that occurs when some change other 
than the experimental treatment occurs during the course of an 
experiment that affects the dependent variable. 

host The computer location where the content for a particular 
Web site physically resides and is accessed. 

human subjects review committee An official group that 
carefully reviews proposed research design to try to make sure 
that no harm can come to any research participant. 

hypothesis Formal statement of an unproven proposition that is 
empirically testable. 

hypothesis test of a proportion A test that is conceptually 
similar to the one used when the mean is the characteristic of 
interest but that differs in the mathematical formulation of the 
standard error of the proportion. 

hypothetical constructs Variables that are not directly observable 
but are measurable through indirect indicators, such as verbal 
expression or overt behavior. 


idealism A term that reflects the degree to which one bases one’s 
morality on moral standards. 
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image profile A graphic representation of semantic differential 
data for competing brands, products, or stores to highlight 
comparisons. 

importance-performance analysis Another name for quadrant 
analysis. 

impute To fill in a missing data point through the use of a statisti- 
cal algorithm that provides a best guess for the missing response 
based on available information. 

independent samples t-test A test for hypotheses stating the mean 
scores for some interval- or ratio-scaled variable differ based on 
some less-than interval classificatory variable. 

independent variable A variable that is expected to influence the 
dependent variable in some way. 

index measure An index assigns a value based on how much of 
the concept being measured is associated with an observation. 
Indexes often are formed by putting several variables together. 

index numbers Scores or observations recalibrated to indicate 
how they relate to a base number. 

index of retail saturation A calculation that describes the rela- 
tionship between retail demand and supply. 

inductive reasoning The logical process of establishing a general 
proposition on the basis of observation of particular facts. 

inferential statistics The use of statistics to project characteristics 
from a sample to an entire population. 

information completeness Having the right amount of 
information. 

information Data formatted (structured) to support decision 
making or define the relationship between two facts. 

informed consent Consent given by an individual who under- 
stands what the researcher wants him or her to do and who 
agrees to participate. 

in-house editing A rigorous editing job performed by a central- 
ized office staff: 

in-house interviewer A fieldworker who is employed by the 
company conducting the research. 

in-house research Research performed by employees of the 
company that will benefit from the research. 

instrumentation effect A nuisance that occurs when a change in 
the wording of questions, a change in interviewers, or a change 
in other procedures causes a change in the dependent variable. 

interaction effect Differences in dependent variable means due to 
a specific combination of independent variables. 

interactive help desk In an Internet questionnaire, a live, real- 
time support feature that solves problems or answers questions 
respondents may encounter in completing the questionnaire. 

interactive medium A medium, such as the Internet, that a per- 
son can use to communicate with and interact with other users. 

interdependence techniques Multivariate statistical techniques 
that give meaning to a set of variables or seek to group things 
together; no distinction is made between dependent and 
independent variables. 

internal and proprietary data Secondary data that originate 
inside the organization. 

internal consistency A measure’s homogeneity or the extent to 
which each indicator of a concept converges on some common 
meaning. 

internal validity A state that exists to the extent that an experi- 
mental variable is truly responsible for any variance in the 
dependent variable. 

Internet A worldwide network of computers that allows users 
access to information from distant sources. 
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Internet survey A self-administered questionnaire posted on a 
Web site. 

interpretation The process of drawing inferences from the analysis 
results. 

interquartile range A measure of variability. 

interrogative techniques Asking multiple what, where, who, 
when, why, and how questions. 

intersubjective certifiability Different individuals following the 
same procedure will produce the same results or come to the 
same conclusion. 

interval scales Scales that have both nominal and ordinal prop- 
erties, but that also capture information about differences in 
quantities of a concept from one observation to the next. 

interviewer bias A response bias that occurs because the presence 
of the interviewer influences respondents’ answers. 

interviewer cheating The practice by fieldworkers of filling in 
fake answers or falsifying interviews. 

interviewer error Mistakes made by interviewers failing to record 
survey responses correctly. 

intranet A company’s private data network that uses Internet 
standards and technology. 

introduction section The part of the body of a research report 
that discusses background information and the specific objec- 
tives of the research. 

inverse (negative) relationship Covariation in which the 
association between variables is in the opposite direction. As 
one goes up, the other goes down. 

item nonresponse Failure of a respondent to provide an answer 
to a survey question. 


judgment (purposive) sampling A nonprobability sampling 
technique in which an experienced individual selects the sample 
based on personal judgment about some appropriate characteris- 
tic of the sample member. 


keyword search A type of computerized search that takes place 
as the search engine searches through millions of Web pages 
for documents containing the keywords. 

knowledge management The process of creating an inclusive, 
comprehensive, easily accessible organizational memory, often 
called the organization’s intellectual capital. 

knowledge A blend of previous experience, insight, and data that 
forms (organizational) memory. 


laboratory experiment A type of research in which the researcher 
has more complete control over the research setting and extrane- 
ous variables. 

ladder of abstraction The organization of concepts in sequence 
from the most concrete and individual to the most general. 

laddering A particular approach to probing, asking respondents 
to compare differences between brands at different levels that 
produces distinctions at the attribute level, the benefit level, and 
the value or motivation level. 

latent construct A concept that is not directly observable or mea- 
surable, but can be estimated through proxy measures. 
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leading question A question that suggests or implies certain 
answers. 

Likert scale A measure of attitudes designed to allow respondents 
to rate how strongly they agree or disagree with carefully con- 
structed statements, ranging from very positive to very negative 
attitudes toward some object. 

literature review A directed search of published works, including 
periodicals and books, that discusses theory and presents empiri- 
cal results that are relevant to the topic at hand. 

loaded question A question that suggests a socially desirable answer 
or that is emotionally charged. 

longitudinal study A survey of respondents at different times, 
thus allowing analysis of response continuity and changes over 
time. 


mail survey A self-administered questionnaire sent to respondents 
through the mail. 

main effect The experimental difference in dependent variable 
means between the different levels of any single experimental 
variable. 

mall intercept interviews Personal interviews conducted in a 
shopping mall. 

manager of decision support systems Employee who supervises 
the collection and analysis of sales, inventory, and other periodic 
customer relationship management (CRM) data. 

managerial action standard A specific performance criterion 
upon which a decision can be based. 

manipulation Means that the researcher alters the level of the 
variable in specific increments. 

manipulation check A validity test of an experimental manipula- 
tion to make sure that the manipulation does produce differ- 
ences in the independent variable. 

marginals Row and column totals in a contingency table, which 
are shown in its margins. 

market tracking The observation and analysis of trends in indus- 
try volume and brand share over time. 

market-basket analysis A form of data mining that analyzes 
anonymous point-of-sale transaction databases to identify coin- 
ciding purchases or relationships between products purchased 
and other retail shopping information. 

marketing-oriented A term describing a firm in which all deci- 
sions are made with a conscious awareness of their effect on the 
customer. 

maturation effects Effects that are a function of time and the 
naturally occurring events that coincide with growth and 
experience. 

mean A measure of central tendency; the arithmetic average. 

measure of association A general term that refers to a number of 
bivariate statistical techniques used to measure the strength of a 
relationship between two variables. 

measurement The process of describing some property of a 
phenomenon of interest, usually by assigning numbers in a 
reliable and valid way. 

median A measure of central tendency that is the midpoint; the 
value below which half the values in a distribution fall. 

median split Dividing a data set into two categories by placing 
respondents below the median in one category and respondents 
above the median in another. 
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mixed-mode survey A study that employs any combination of 
survey methods. 

mode A measure of central tendency; the value that occurs most often. 

model building The use of secondary data to help specify 
relationships between two or more variables; it can involve the 
development of descriptive or predictive equations. 

moderator variable A third variable that changes the nature of a 
relationship between the original independent and dependent 
variables. 

moderator A person who leads a focus group interview and 
ensures that everyone gets a chance to speak and contribute to 
the discussion. 

monadic rating scale Any measure of attitudes that asks respon- 
dents about a single concept in isolation. 

moral standards Principles that reflect beliefs about what is 
ethical and what is unethical. 

mortality effect (sample attrition) A situation that occurs when 
some subjects withdraw from the experiment before it is completed. 

multicollinearity The extent to which independent variables in a 
multiple regression analysis are correlated with each other; high 
multicollinearity can make interpreting parameter estimates 
difficult or impossible. 

multidimensional scaling A statistical technique that measures 
objects in multidimensional space on the basis of respondents’ 
judgments of the similarity of objects. 

multiple regression analysis An analysis of association in 
which the effects of two or more independent variables on 
a single, interval-scaled dependent variable are investigated 
simultaneously. 

multiple-grid question Several similar questions arranged in a 
grid format. 

multistage area sampling A type of sampling that involves 
using a combination of two or more probability sampling 
techniques. 

multivariate analysis of variance (MANOVA) A multivariate 
technique that predicts multiple continuous dependent variables 
with one or more categorical independent variables. 

multivariate statistical analysis Statistical analysis involving three 
or more variables or sets of variables. 

mutually exclusive A grouping in which no overlap exists among 
the fixed-alternative categories. 


neural networks A form of artificial intelligence in which a 
computer is programmed to mimic the way that human brains 
process information. 

no contacts Members of sampling frame who are not at home 
or who are otherwise inaccessible on the first and second 
contact. 

nominal scales Ranking scales that represent the most elementary 
level of measurement in which values are assigned to an object 
for identification or classification purposes only. 

nonparametric statistics A type of statistics appropriate when the 
variables being analyzed do not conform to any known or con- 
tinuous distribution. 

nonprobability sampling A sampling technique in which units 
of the sample are selected on the basis of personal judgment or 
convenience; the probability of any particular member of the 
population being chosen is unknown. 
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nonrespondent error An error that the respondent is not 
responsible for creating, such as when the interviewer marks a 
response incorrectly. 

nonrespondents People who are not contacted or who refuse to 
cooperate in the research. 

nonresponse error The statistical differences between a survey 
that includes only those who responded and a perfect survey 
that would also include those who failed to respond. 

nonspurious association One of three criteria for causality; any 
covariation between a cause and an effect is true and not simply 
due to some other variable. 

normal distribution A symmetrical, bell-shaped distribution that 
describes the expected probability distribution of many chance 
occurrences. 

nuisance variables Items that may affect the dependent measure 
but are not of primary interest. 

numerical scale An attitude rating scale similar to a semantic dif- 
ferential except that it uses numbers instead of verbal descrip- 
tions as response options to identify response positions. 


observation The systematic process of recording the behavioral pat- 
terns of people, objects, and occurrences as they are witnessed. 

observer bias A distortion of measurement resulting from the 
cognitive behavior or actions of a witnessing observer. 

online focus group A qualitative research effort in which a group 
of individuals provides unstructured comments by entering their 
remarks into an electronic Internet display board of some type. 

open-ended boxes In an Internet questionnaire, boxes where 
respondents can type in their own answers to open-ended 
questions. 

open-ended response questions Questions that pose some 
problem and ask respondents to answer in their own words. 

operationalization The process of identifying scales that cor- 
respond to variance in a concept to be involved in a research 
process. 

operationalizing The process of identifying the actual measure- 
ment scales to assess the variables of interest. 

opt in To give permission to receive selected e-mail, such as ques- 
tionnaires, from a company with an Internet presence. 

optical scanning system A data processing input device that 
reads material directly from mark-sensed questionnaires. 

oral presentation A spoken summary of the major findings, 
conclusions, and recommendations, given to clients or line 
managers to provide them with the opportunity to clarify any 
ambiguous issues by asking questions. 

order bias Bias caused by the influence of earlier questions in a 
questionnaire or by an answer’s position in a set of answers. 

ordinal scales Ranking scales allowing items to be arranged based 
on how much of some quality they possess. 

outlier A value that lies outside the normal range of the data. 

outside agency An independent research firm contracted by the 
company that actually will benefit from the research. 


paired comparison A measurement technique that involves 
presenting the respondent with two objects and asking the 
respondent to pick the preferred object; more than two objects 
may be presented, but comparisons are made in pairs. 
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paired-samples t-test An appropriate test for comparing the 
scores of two interval variables drawn from related populations. 

parametric statistics Statistics that involve numbers with known, 
continuous distributions; when the data are interval or ratio 
scaled and the sample size is large, parametric statistical proce- 
dures are appropriate. 

partial correlation The correlation between two variables after 
taking into account the fact that they are correlated with other 
variables too. 

participant-observation An ethnographic research approach where 
the researcher becomes immersed within the culture that he or 
she is studying and draws data from his or her observations. 

percentage distribution A frequency distribution organized into 
a table (or graph) that summarizes percentage values associated 
with particular values of a variable. 

performance-monitoring research Research that regularly, 
sometimes routinely, provides feedback for evaluation and 
control of business activity. 

personal interview Face-to-face communication in which an 
interviewer asks a respondent to answer questions. 

phenomenology A philosophical approach to studying human expe- 
riences based on the idea that human experience itself is inherently 
subjective and determined by the context in which people live. 

piggyback A procedure in which one respondent stimulates 
thought among the others; as this process continues, increasingly 
creative insights are possible. 

pilot study A small-scale research project that collects data from 
respondents similar to those to be used in the full study. 

pivot question A filter question used to determine which version 
of a second question will be asked. 

placebo An experimental tool used to create the perception that 
some substance or procedure has been administered. 

placebo effect The effect in a dependent variable associated with 
the psychological impact that goes along with knowledge of 
some treatment being administered. 

plug value An answer that an editor “plugs in” to replace blanks 
or missing values so as to permit data analysis; the choice of 
value is based on a predetermined decision rule. 

point estimate An estimate of the population mean in the form of 
a single value, usually the sample mean. 

pooled estimate of the standard error An estimate of the stan- 
dard error for a t-test of independent means that assumes the 
variances of both groups are equal. 

population (universe) Any complete group of entities that share 
some common set of characteristics. 

population distribution A frequency distribution of the elements 
of a population. 

population element An individual member of a population. 

population parameters Variables in a population or measured 
characteristics of the population. 

pop-up boxes In an Internet questionnaire, boxes that appear 
at selected points and contain information or instructions for 
respondents. 

preliminary tabulation A tabulation of the results of a pretest 
to help determine whether the questionnaire will meet the 
objectives of the research. 

pretest A small-scale study in which the results are only prelimi- 
nary and intended only to assist in design of a subsequent study. 

pretesting A screening procedure that involves a trial run with a 
group of respondents to iron out fundamental problems in the 
survey design. 
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primary sampling unit (PSU) A term used to designate a unit 
selected in the first stage of sampling. 

probability The long-run relative frequency with which an event 
will occur. 

probability sampling A sampling technique in which every 
member of the population has a known, nonzero probability of 
selection. 

probing An interview technique that tries to draw deeper and 
more elaborate explanations from the discussion. 

problem A situation that occurs when there is a difference between 
the current conditions and a more preferable set of conditions. 

problem definition The process of defining and developing a 
decision statement and the steps involved in translating it into 
more precise research terminology, including a set of research 
objectives. 

product-oriented A term used to describe a firm that prioritizes 
decision making in a way that emphasizes technical superiority 
in the product. 

production-oriented A term used to describe a firm that prioritizes 
efficiency and effectiveness of the production processes in making 
decisions. 

projective technique An indirect means of questioning enabling 
respondents to project beliefs and feelings onto a third party, an 
inanimate object, or a task situation. 

proportion The percentage of elements that meet some criterion. 

proportional stratified sample A stratified sample in which 
the number of sampling units drawn from each stratum is in 
proportion to the population size of that stratum. 

propositions Statements explaining the logical linkage among 
certain concepts by asserting a universal connection between 
concepts. 

proprietary business research The gathering of new data to 
investigate specific problems. 

pseudo-research A study conducted not to gather information for 
marketing decisions but to bolster a point of view and satisfy 
other needs. 

psychogalvanometer A device that measures galvanic skin 
response, a measure of involuntary changes in the electrical 
resistance of the skin. 

pull technology A procedure by which consumers request infor- 
mation from a Web page and the browser then determines a 
response; the consumer is essentially asking for the data. 

pupilometer A mechanical device used to observe and record 
changes in the diameter of a subject’s pupils. 

push button In a dialog box on an Internet questionnaire, a small 
outlined area, such as a rectangle or an arrow, that the respondent 
clicks on to select an option or perform a function, such as submit. 

push poll Telemarketing under guise of research. 

push technology A program that sends data to a user’s computer 
without a request being made; software is used to guess what 
information might be interesting to consumers based on the 
pattern of previous responses. 

p-value Probability value, or the observed or computed signifi- 
cance level; p-values are compared to significance levels to test 


hypotheses. 


quadrant analysis An extension of cross-tabulation in which 
responses to two rating-scale questions are plotted in four 
quadrants of a two-dimensional table. 
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qualitative business research Research that addresses business 
objectives through techniques that allow the researcher to pro- 
vide elaborate interpretations of phenomena without depend- 
ing on numerical measurement; its focus is on discovering true 
inner meanings and new insights. 

qualitative data Data that are not characterized by numbers, and 
instead are textual, visual, or oral; the focus is on stories, visual 
portrayals, meaningful characterizations, interpretations, and 
other expressive descriptions. 

quantitative business research Business research that addresses 
research objectives through empirical assessments that involve 
numerical measurement and analysis. 

quantitative data Data that represent phenomena by assigning 
numbers in an ordered and meaningful way. 

quasi-experimental designs Experimental designs that do 
not involve random allocation of subjects to treatment 
combinations. 

quota sampling A nonprobability sampling procedure that ensures 
that various subgroups of a population will be represented on 
pertinent characteristics to the exact extent that the investigator 
desires. 


radio button In an Internet questionnaire, a circular icon resem- 
bling a button that activates one response choice and deactivates 
others when a respondent clicks on it. 

random digit dialing The use of telephone exchanges and a 
table of random numbers to contact respondents with unlisted 
phone numbers. 

random sampling error A statistical fluctuation that occurs 
because of chance variation in the elements selected for a 
sample. 

randomization The random assignment of subject and treatments 
to groups; it is one device for equally distributing the effects of 
extraneous variables to all conditions. 

randomized-block design A design that attempts to isolate the 
effects of a single extraneous variable by blocking out its effects 
on the dependent variable. 

ranking A measurement task that requires respondents to rank 
order a small number of stores, brands, or objects on the basis of 
overall preference or some characteristic of the stimulus. 

rating A measurement task that requires respondents to estimate 
the magnitude of a characteristic or quality that a brand, store, 
or object possesses. 

ratio scales Ranking scales that represent the highest form of mea- 
surement in that they have all the properties of interval scales 
with the additional attribute of representing absolute quantities; 
characterized by a meaningful absolute zero. 

raw data The unedited responses from a respondent exactly as 
indicated by that respondent. 

record A collection of related fields that represents the responses 
from one sampling unit. 

refusals People who are unwilling to participate in a research 
project. 

relativism The rejection of moral standards in favor of the accept- 
ability of some action. This way of thinking rejects absolute 
principles in favor of situation-based evaluations. 

relevance The characteristics of data reflecting how pertinent these 
particular facts are to the situation at hand. 
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reliability An indicator of a measure’s internal consistency. 

repeated measures Experiments in which an individual subject is 
exposed to more than one level of an experimental treatment. 

replication Repitition of research to determine whether the same 
interpretation will be drawn if the study is repeated by differ- 
ent researchers with different respondents following the same 
methods. 

report format The makeup or arrangement of parts necessary to a 
good research report. 

research analyst A person responsible for client contact, project 
design, preparation of proposals, selection of research suppliers, 
and supervision of data collection, analysis, and reporting activities. 

research assistants Research employees who provide technical 
assistance with questionnaire design, data analyses, and similar 
activities. 

research design A master plan that specifies the methods and pro- 
cedures for collecting and analyzing the needed information. 

research follow-up Recontacting decision makers and/or clients 
after they have had a chance to read over a research report in 
order to determine whether additional information or clarifica- 
tion is necessary. 

research generalist A research employee who serves as a link 
between management and research specialists. The research 
generalist acts as a problem definer, an educator, a liaison, a 
communicator, and a friendly ear. 

research methodology section The part of the body of a report 
that presents the findings of the project. It includes tables, 
charts, and an organized narrative. 

research objectives The goals to be achieved by conducting research. 

research program Numerous related studies that come together 
to address multiple, related research objectives. 

research project A single study that addresses one or a small 
number of research objectives. 

research proposal A written statement of the research design. 

research questions Questions that express the research objectives 
in terms of questions that can be addressed by research. 

research report An oral presentation or written statement of 
research results, strategic recommendations, and/or other 
conclusions to a specific audience. 

research suppliers Commercial providers of research services. 

researcher-dependent Research in which the researcher must 
extract meaning from unstructured responses such as text from 
a recorded interview or a collage representing the meaning of 
some experience. 

respondent error A category of sample bias resulting from 
some respondent action or inaction such as nonresponse or 
response bias. 

respondents People who verbally answer an interviewer’s ques- 
tions or provide answers to written questions. 

response bias A bias that occurs when respondents either 
consciously or unconsciously tend to answer questions with a 
certain slant that misrepresents the truth. 

response latency The amount of time it takes to make a choice 
between two alternatives, used as a measure of the strength 
of preference. 

response rate The number of questionnaires returned or com- 
pleted divided by the number of eligible people who were 
asked to participate in the survey. 

results section The part of the body of a report that presents 
the findings of the project. It includes tables, charts, and an 
organized narrative. 
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reverse coding Coding in which the value assigned for a response 
is treated oppositely from the other items. 

reverse directory A directory similar to a telephone directory 
except that listings are by city and street address or by phone 
number rather than alphabetical by last name. 

reverse recoding A method of making sure all the items forming 
a composite scale are scored in the same direction. Negative 
items can be recoded into the equivalent responses for a non- 
reverse coded item. 

rule of parsimony The rule of parsimony suggests an explanation 
involving fewer components is better than one involving more. 


sample A subset, or some part, of a larger population. 

sample bias A persistent tendency for the results of a sample to 
deviate in one direction from the true value of the population 
parameter. 

sample distribution A frequency distribution of a sample. 

sample selection error An administrative error caused by 
improper sample design or sampling procedure execution. 

sample statistics Variables in a sample or measures computed 
from sample data. 

sample survey A more formal term for a survey. 

sampling Any procedure that draws conclusions based on mea- 
surements of a portion of the population. 

sampling distribution A theoretical probability distribution of 
sample means for all possible samples of a certain size drawn 
from a particular population. 

sampling frame A list of elements from which a sample may be 
drawn, also called working population. 

sampling frame error An error that occurs when certain sample 
elements are not listed or are not accurately represented in a 
sampling frame. 

sampling unit A single element or group of elements subject to 
selection in the sample. 

scales A device providing a range of values that correspond to 
different values in a concept being measured. 

scanner data The accumulated records resulting from point of sale 
data recordings. 

scanner-based consumer panel A type of consumer panel in 
which participants’ purchasing habits are recorded with a laser 
scanner rather than with a purchase diary. 

scientific method A set of prescribed procedures for establishing 
and connecting theoretical statements about events, for analyz- 
ing empirical evidence, and for predicting events yet unknown; 
techniques or procedures used to analyze empirical evidence in 
an attempt to confirm or disprove prior conceptions. 

search engine A computerized directory that allows anyone to search 
the World Wide Web for information using a keyword search. 

secondary data Data that have been previously collected for some 
purpose other than the one at hand. 

secondary sampling unit A unit selected in the second stage of 
sampling. 

selection effect Sample bias from differential selection of respon- 
dents for experimental groups. 

self-administered questionnaires Surveys in which the respondent 
takes the responsibility for reading and answering the questions. 

self-selection bias A bias that occurs because people who feel 
strongly about a subject are more likely to respond to survey 
questions than people who feel indifferent about it. 
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semantic differential A measure of attitudes that consists of a 
series of seven-point rating scales that use bipolar adjectives to 
anchor the beginning and end of each scale. 

sensitivity A measurement instrument’s ability to accurately mea- 
sure variability in stimuli or responses. 

significance level A critical probability associated with a statistical 
hypothesis test that indicates how likely an inference support- 
ing a difference between an observed value and some statistical 
expectation is true; the acceptable level of Type I error. 

simple (bivariate) linear regression A measure of linear associa- 
tion that investigates straight-line relationships between a con- 
tinuous dependent variable and an independent variable that is 
usually continuous but can be a categorical dummy variable. 

simple random sampling A sampling procedure that assures each 
element in the population of an equal chance of being included 
in the sample. 

simple-dichotomy (dichotomous) question A fixed-alternative 
question that requires the respondent to choose one of two 
alternatives. 

single-source data Diverse types of data offered by a single com- 
pany, usually integrated on the basis of a common variable such 
as geographic area or store. 

site analysis techniques Techniques that use secondary data to 
select the best location for retail or wholesale operations. 

situation analysis The gathering of background information to 
familiarize researchers and managers with the decision-making 
environment. 

smart agent software Software capable of learning an Internet 
user’s preferences and automatically searching out information 
in selected Web sites and then distributing it. 

snowball sampling A sampling procedure in which initial respon- 
dents are selected by probability methods and additional respon- 
dents are obtained from information provided by the initial 
respondents. 

social desirability bias Bias in responses caused by respondents’ 
desire, either conscious or unconscious, to gain prestige or 
appear in a different social role. 

sorting A measurement task that presents a respondent with sev- 
eral objects or product concepts and requires the respondent to 
arrange the objects into piles or classify the product concepts. 

split-ballot technique The practice of using two alternative phras- 
ings of the same question for respective halves of a sample to 
elicit a more accurate total response than would a single phrasing. 

split-half method A method for assessing internal consistency by 
checking the results of one-half of a set of scaled items against 
the results from the other half. 

spyware Software placed on a computer without consent or 
knowledge of the user. 

standard deviation A quantitative index of a distribution’s spread, 
or variability; the square root of the variance for a distribution. 

standard error of the mean The standard deviation of the sam- 
pling distribution. 

standardized normal distribution A purely theoretical prob- 
ability distribution that reflects a specific normal curve for the 
standardized value, Z. 

standardized regression coefficient (B) The estimated coef- 
ficient indicating the strength of relationship between an 
independent variable and dependent variable expressed on a 
standardized scale where higher absolute values indicate stronger 
relationships (range is from —1 to 1). 
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standardized research service Companies that develop a unique 
methodology for investigating a business specialty area. 

Stapel scale A measure of attitudes that consists of a single adjec- 
tive in the center of an even number of numerical values. 

statistical base The number of respondents or observations (in a 
row or column) used as a basis for computing percentages. 

status bar In an Internet questionnaire, a visual indicator that tells the 
respondent what portion of the survey he or she has completed. 

stratified sampling A probability sampling procedure in which sim- 
ple random subsamples that are more or less equal on some char- 
acteristic are drawn from within each stratum of the population. 

string characters Computer terminology to represent formatting 
a variable using a series of alphabetic characters (nonnumeric 
characters) that may form a word. 

structured question A question that imposes a limit on the num- 
ber of allowable responses. 

subjective A term meaning research results are researcher-dependent, 
meaning different researchers may reach different conclusions based 
on the same interview. 

subjects The sampling units for an experiment, usually human 
respondents who provide measures based on the experimental 
manipulation. 

summated scale A scale created by simply summing (adding 
together) the response to each item making up the composite 
measure. 

survey A research technique in which a sample is interviewed 
in some form or the behavior of respondents is observed and 
described in some way. 

symptoms Observable cues that serve as a signal of a problem 
because they are caused by that problem. 

syndicated service A research supplier that provides standardized 
information for many clients in return for a fee. 

systematic error Error resulting from some imperfect aspect 
of the research design that causes respondent error or from a 
mistake in the execution of the research. 

systematic or nonsampling error A type of error that occurs if 
the sampling units in an experimental cell are somehow differ- 
ent than the units in another cell, and this difference affects the 
dependent variable. 

systematic sampling A sampling procedure in which a starting 
point is selected by a random process and then every nth num- 
ber on the list is selected. 


tabulation The orderly arrangement of data in a table or other 
summary format showing the number of responses to each 
response category; tallying. 

tachistoscope A device that controls the amount of time a subject 
is exposed to a visual image. 

t-distribution A symmetrical, bell-shaped distribution that is con- 
tingent on sample size, has a mean of 0 and a standard deviation 
equal to 1. 

telephone interviews Personal interviews conducted by tele- 
phone, the mainstay of commercial survey research. 

television monitoring Computerized mechanical observation 
used to obtain television ratings. 

temporal sequence One of three criteria for causality that deals with 
the time order of events—the cause must occur before the effect. 

tertiary sampling unit A term used to designate a unit selected in 
the third stage of sampling. 
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test of differences An investigation of a hypothesis stating that 
two (or more) groups differ with respect to measures on a 
variable. 

test tabulation Tallying of a small sample of the total number 
of replies to a particular question in order to construct coding 
categories. 

test units The subjects or entities whose responses to the experi- 
mental treatment are measured or observed. 

testing effects A nuisance effect occurring when the initial mea- 
surement or test alerts or primes subjects in a way that affects 
their response to the experimental treatments. 

test-market An experiment that is conducted within actual market 
conditions. 

test-retest method A reliability approach involving the adminis- 
tration of the same scale or measure to the same respondents at 
two separate points in time. 

thematic apperception test (TAT) A test that presents subjects 
with an ambiguous picture(s) in which consumers and products 
are the center of attention; the investigator asks the subject to 
tell what is happening in the picture(s) now and what might 
happen next. 

themes Meaning identified by the frequency with which the same 
term (or a synonym) arises in the narrative description. 

theory A formal, logical explanation of some events that includes 
predictions of how things relate to one another. 

Thurstone scale An attitude scale in which judges assign scale 
values to attitudinal statements and subjects are asked to respond 
to these statements. 

time series design A research design used for an experiment 
investigating long-term structural changes. 

timeliness A term indicating that the data are current enough to still 
be relevant. 

total quality management A business philosophy that empha- 
sizes market-driven quality as a top organizational priority. 

total variability The sum of within-group variance and between- 
groups variance. 

totally exhaustive A category exists for every respondent in 
among the fixed-alternative categories. 

tracking study A type of longitudinal study that uses successive 
samples to compare trends and identify changes in variables 
such as consumer satisfaction, brand image, or advertising 
awareness. 

t-test A hypothesis test that uses the fdistribution. A univariate 
t-test is appropriate when the variable being analyzed is interval 
or ratio. 

Type I error An error caused by rejecting the null hypothesis 
when it is true; it has a probability of alpha. Practically, a Type I 
error occurs when the researcher concludes that a relationship 
or difference exits in the population when in reality it does not 
exist. 

Type II error An error caused by failing to reject the null hypoth- 
esis when the alternative hypothesis is true; it has a probability 
of beta. Practically, a Type II error occurs when a researcher 
concludes that no relationship or difference exists when in fact 
one does exist. 


unbalanced rating scale A fixed-alternative rating scale that has 
more response categories at one end than the other resulting in 
an unequal number of positive and negative categories. 
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undisguised questions Straightforward questions that assume the 
respondent is willing to answer. 

uniform resource locator (URL) A Web site address that Web 
browsers recognize. 

unit of analysis What or who should provide the data and at 
what level of aggregation it should be analyzed (organizations, 
strategic business units, departments, families, individuals . . .). 

univariate statistical analysis Tests of hypotheses involving only 
one variable. 

unobtrusive methods Methods in which research respondents do 
not have to be disturbed for data to be gathered. 

unstructured question A question that does not restrict the 
respondents’ answers. 


validity The accuracy of a measure or the extent to which a score 
truthfully represents a concept. 

value labels Unique labels assigned to each possible numeric code 
for a response. 

variable piping software Software that allows variables to 
be inserted into an Internet questionnaire as a respondent is 
completing it. 

variable Anything that varies or changes from one instance to 
another; variables can exhibit differences in value, usually in 
magnitude or strength, or in direction. 

variance A measure of variability or dispersion. Its square root is 
the standard deviation. 

variate A mathematical way in which a set of variables can be rep- 
resented with one equation. 
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verification Quality-control procedures in fieldwork intended to 
ensure that interviewers are following the sampling procedures 
and to determine whether interviewers are cheating. 

visible observation Observation in which the observer’s presence 
is known to the subject. 

voice-pitch analysis A physiological measurement technique that 
records abnormal frequencies in the voice that are supposed to 
reflect emotional reactions to various stimuli. 


welcome screen The first Web page in an Internet survey, which 
introduces the survey and requests that the respondent enter a 
password or pin. 

within-group error or variance The sum of the differences 
between observed values and the group mean for a given set of 
observations, also known as total error variance. 

within-subjects design Involves repeated measures because with 
each treatment the same subject is measured. 

World Wide Web (WWW) A portion of the internet that is a 
system of computer servers that organize information into docu- 
ments called Web pages. 


Z-test for differences of proportions A technique used to test 
the hypothesis that proportions are significantly different for two 
independent samples or groups. 
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Implementation of course of action, 9—10 
Importance-performance analysis, 493 
Imputing missing value, 466 
Incentives 
for fieldworkers, 457 
to respond, 216, 222 
Inconsistency, checking data for, 
464—466 
Independent samples t-test, 
534-538, 542 
Independent variables, 120, 257, 
260-263, 491 
Index measure, 303, 331 
Index numbers, 496 
Index of retail saturation, 168—169 
Inductive reasoning, 44—45 
Inferential statistics, 413 
Information 
for business decisions, 3—5, 19 
completeness of, 21, 466—467 
definition of, 19, 20 
valuable, characteristics of, 19, 21 
Information technology, 33-34 
Informed consent, 90—91, 94 
In-house editing, 464—466 
In-house interviewers, 444 
In-house research, 76-77 
Initial quality improvement stage of 
total quality management, 201 
Input management, 25—28 
In-Stat, 185-186 
Instrumentation effect, 276 
Integrity of data, 463, 465 
Interaction effect, 260 
Interactive help desk, 360 
Interactive media, 32-33, 208 
Interactive questionnaires, software to 
make, 360-361 
Interdependence techniques of 
multivariate statistical analysis 
cluster analysis, 597-599 
factor analysis, 593-597 
multidimensional scaling, 599-600 
overview of, 583, 584, 601 
Internal and proprietary data, 171-172 
Internal consistency, 305-306, 310 
Internal records, 25 
Internal Revenue Service, research 
proposal for, 124 
Internal validity, 274-277, 278 
Internet 
data access and, 31 
data collection and, 31—32 
description of, 30-31 
navigating, 32 
privacy issues with, 92, 102 
research reports on, 626 
as source of data, 172, 174 
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Internet 2, 34 
Internet surveys 
advantages and disadvantages of, 
227-230, 232 
initial contact, 447 
layout of, 356-360 
sampling and, 406—409 
Interpretation of data analysis, 501-503 
Interquartile range, 501 
Interrogative techniques, 114 
Intersubjective certifiability, 135 
Interval scale, 300 
Interviewer bias, 193 
Interviewer error, 194 
Interviewer influence, 211—212 
Interviewers 
briefing sessions for, 454 
cheating by, 194-195, 456 
instructions for, 352 
training for, 445 
Interviewing 
basic principles of, 452 
required practices for, 452—453 
total quality management for, 455 
Interview process, 113-114 
Interviews. See also Fieldwork; Focus 
group interviews; Interviewers; 
Interviewing; Personal 
interviews; Telephone interviews 
change, 115 
combining direct observation 
with, 244 
depth, 150-151 
door-to-door, 212-214 
as interactive communication, 208 
semi-structured, 151-152 
shopping mall intercepts, 
212-214, 232 
terminating, 451 
verification of, by reinterviewing, 457 
Intranet, 34 
Introduction section of research 
report, 615 
Intuit, 188 
Intuitive decision making, 83 
Inverse relationship, 561 
Investing behavior, and peer 
pressure, 294 
iPhone, 34 
Isolation of subjects, 269 
Item nonresponse, 211, 466 
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Jack Daniels, 14, 15 
J. D. Power and Associates, 87, 335 
Jelly Belly brand, 3—4, 5 
Job attitude, and self-efficacy 
intervention, 257—260 
Jobs in business research 
director of research, 80-81 
large firms, 79-80 
mid-sized firms, 78-79 
research generalist, 85 
salaries for, 81 
small firms, 78 
Johnson & Johnson, 339 
Judgment, determining sample size on 
basis of, 438 
Judgment sampling, 396 
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Kaplan, Inc., 205 

Keying mail surveys, 225 
Keyword search, 32 

Kia Motors, 165 

Kiosk interactive surveys, 230-231 
Kish method of sampling, 402 
Knowledge, definition of, 22 


Knowledge management, 22 
Krispy Kreme, 18-19 
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Laboratory experiments, 271—272 
Laddering, 150 
Ladder of abstraction, 40, 41 
Ladder scales, 324 
Latent construct, 41—43 
Layout for questionnaires 

Internet, 356-360 

traditional, 352-356 
Leading questions, 344—345 
Legitimate “don’t know” answers, 467 
Length 

of mail surveys, 221 

of personal interviews, 210 

of questionnaires, 233 

of telephone interviews, 217 
Letters 

of authorization, 613 

cover, for mail surveys, 222, 223 

of transmittal, 613, 614 
Level of precision, determination of 

after data collection, 439 
Level of scale measurement, and selection 
of statistical techniques, 517 

Libraries, as sources of data, 172 
Likert scales, 303, 318-319, 341 
Limited research service companies, 88 
Line graphs, 622—623 
List brokers, 392 
List-wise deletion, 467 
Literature review, 65 
Loaded questions, 344—345 
Longitudinal studies, 197—198, 200 
Love, as hypothetical construct, 317 
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Macy’s, 110 
Magnitude of error, 434 
Mail surveys, 219-221, 232 
Main effect, 259 
Mall intercept interviews, 213-214, 232 
Management 
conflict between research and, 
81-85, 86 
research as facilitating, 8—9 
Managerial action standard, 123 
Manager of decision support systems, 79 
Manipulation 
definition of, 59 
of independent variables, 260-263 
Manipulation check, 275 
Manual calculation of F-statistic, 552-554 
Marginals, 489 
Marginal tabulation, 488 
Market-basket analysis, 169 
Marketing Information Systems, Inc., 505 
Marketing-oriented firms, 8 
Market segments, and descriptive 
research, 56 
Market-share data, 176—177 
Market tracking, 165 
Mark-sensed questionnaires, 477 
Marriott Corporation, 78, 79-80 
Mars M&M characters, 55 
Matching subjects, 265 
Maturation effect, 276 
Maxjet, 12 
Mazda Motor Europe, 255 
MBA degree, market for, 50-51 
McDonald’s, 60, 373 
Mean 
description of, 415-417 
sample size for questions involving, 
433-435 
Mean absolute deviation, 419 


Mean squared deviation, 420 
Measurement. See also Attitude 
measurement; Scale measurement 
concepts and, 295 
criteria for evaluating, 305 
operational definitions and, 295-296 
overview of, 293—295 
reliability of, 305-307, 309 
sensitivity of, 309 
validity of, 307-309 
Measure of association, 559—560 
Measures of central tendency 
mean, 415—417 
median, 416, 418 
mode, 416, 418 
strengths and weaknesses of, 439 
Measures of dispersion 
range, 418-419 
standard deviation, 419—421 
Mechanical observation, 247—249 
Median, 416, 418 
Median split, 494—495 
Media phones, 185-186 
Media sources of data, 175—176 
Memory, questions that may tax, 
347-348 
Mere-measurement effect, 195, 196 
Methodology, selection of, 67 
Microsoft, 339 
MINITAB, 499 
Misrepresentation of research, 93, 98, 
99, 620-621 
Missing data, handling, 479 
Mixed-mode surveys, 231 
Mobile phone interviews, 214-215 
Mobile surveys, 207 
Mode, 416, 418 
Model building, 166-169 
Moderators of focus groups, 145—146 
Moderator variables, 492 
Monadic rating scales, 329 
Money. See Budget for research 
Moral standards, 88 
Mortality effect, 277 
Mr. Peanut, 55 
Multicollinearity, 588 
Multidimensional scaling, 599—600 
Multiple-grid questions, 352 
Multiple regression analysis 
example of, 585 
interpreting results of, 588-589 
overview of, 584—585 
purposes of, 600 
R? in, 586 
regression coefficients in, 585-586 
statistical significance in, 586, 588 
Multistage area sampling, 402—404 
Multivariate analysis of variance 
(MANOVA), 589, 590, 591 
Multivariate statistical analysis 
classifying techniques of, 582-584 
definition of, 509, 581 
Music 
for mobile phones, 165 
social networking sites and, 228 
Mutually exclusive response 
alternative, 341 
Mystery shoppers/diners, 238, 244 
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National Assessment of Adult 
Literacy, 210 

National Do Not Call Registry, 214, 
215, 236 

Negative relationship, 561 

NeoTech Mobile-Trak, 248 


Netflix, 136 
Net promoter surveys, 188 
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Networking, 30 
Neural networks, 169 
Neuroco, 251 
Neutral questions, asking, 449 
No contacts, 190 
Nominal scales, 297—298 
Noninteractive media, 208 
Nonparametric statistics, 517—518 
Nonprobability sampling 
comparison of techniques of, 404 
convenience, 396, 408 
description of, 395 
judgment (purposive), 396 
quota, 396-397 
snowball, 398 
Nonrespondent error, 462 
Nonrespondents, 190 
Nonresponse error 
mail surveys and, 222 
overview of, 189-191 
sampling and, 394-395 
Nonsampling error, 264, 393-395 
Nonspurious association, 58-59 
Nonverbal communications, 241—242 
“No opinion” option, 467—468 
Normal curve, area under, 640 
Normal distribution, 421—424 
Norman Estates wine, 56 
Nostalgia, trend toward, 580-581 
Nuisance variables, 264 
Null hypothesis, 510 
Numerical scales, 322 
Nutrition labels, 6 
N-way ANOVA, 589-590 


(0) 
Objectives 
decision statements and, 116—118, 123 
defining, 63—66, 113—114 
survey questions and, 363 
writing, 120—121 
Objectivity, by researchers, 98 
Observable phenomena, 239 
Observation, definition of, 239 
Observation of human behavior 
complementary evidence and, 242 
direct observation, 242-244 
ethical issues in, 245 
overview of, 241—242 
Observation techniques 
content analysis, 246—247 
direct, 242—244 
in ethnography, 138—139 
example of, 67—68 
limitations of, 240 
mechanical, 247—252 
mystery shoppers/diners, 238, 244 
nature of, 240 
for physical phenomena, 245-246 
in qualitative research, 152—153 
Observer bias, 243 
OLS. See Ordinary least-squares 
method of regression analysis 
Olson Zaltman Associates, 449 
One-group pretest-posttest design, 279 
One-shot design, 279 
One-tailed test, 521 
One-way ANOVA, 541 
Online focus groups, 148-149 
Open-ended boxes, 358, 359 
Open-ended response questions 
coding responses to, 474—477 
description of, 338-339, 363 
recording responses to, 450 
Operational definition 
description of, 295-296 
example of, 297 
of target population, 390 
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Operationalizing variables, 42—43 
Optical scanning systems, 477 
Opt-in lists, 409 
Oral presentation of research results, 
625-626 
Order bias, 349 
Ordinal scales, 299-300 
Ordinary least-squares method of 
regression analysis 
equations, arithmetic behind, 
578-579 
hypothesis testing and, 574 
interpreting regression output, 
572-573 
overview of, 569-570 
plotting regression line, 573-574 
statistical significance of model, 
570-572 
Organizational structure of business 
research, 77—80 
Outlier, 501 
Outside agencies, research by, 76, 77 
Outside vendors, 27 
Ownership, question wording and 
measurement scales for, 377—378 
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Paging layout, 357 
Paired comparisons, 327-328 
Paired samples f-test, 538-540 
Pair-wise deletion, 467 
Panel samples, 406, 407—408 
Pantry audits, 246 
Parameter estimates, 429—432, 566-567 
Parametric statistics, 517—518 
Parlin, Charles Coolidge, 245—246 
Partial correlation, 586 
Participant-observation, 138 
Participants, rights and obligations of, 
90-94, 96. See also Respondents; 
Subjects 
Participation 
gaining for interview, 447 
Internet surveys and, 227 
personal interviews and, 211 
in surveys, 4 
Partitioning variance in ANOVA, 
544-545 
Passive research, and right to privacy, 92 
Path estimate, 566 
Pearson product-moment correlation, 
564, 645 
Peer pressure, and investing 
behavior, 294 
Peer review process, 96 
Percentage cross-tabulations, 490—491 
Percentage distribution, 413—414 
Perceptual map, 600 
Performance-monitoring research, 10 
Personal interviews 
advantages of, 209-211, 232 
description of, 209 
disadvantages of, 211-212, 232 
initial contact, 445 
layout of pages from, 355-356 
questions for, 341-342 
Personnel. See Jobs in business research 
Petabyte, 472 
Phenomenology, 137-138 
Philip Morris, 144 
Photographs, sampling of, 388, 389 
Physical phenomena, observation of, 
245-246 
Physiological reactions, measurement 
of, 251-252 
Pie charts, 498, 621-622 
Piggyback, 143 
Pilot studies, 65 


Pivot questions, 350 
Placebo, 93, 269 
Placebo effect, 269 
Planning tools, research proposals as, 125 
Plug value, 466 
Point estimates, 429 
Pointsec Mobile Technologies, 442 
Political polls, accuracy of, 430 
Pooled estimate of the standard error, 535 
Population, 387. See also Target 
population 
Population distribution, 424—425, 426 
Population element, 387 
Population mean, calculation of, 428 
Population parameters, 413 
Population size, and sample size, 
435, 439 
Pop-up boxes, 358 
Posttest-only control group design, 
281-282 
PowerPoint, 10/20/30 rule of, 626 
Precoding fixed-alternative responses, 
472-474 
Preliminary tabulation, 362 
Pretest 
of CAHPS Hospital Survey, 361 
description of, 65 
editing questionnaires and, 468 
of questionnaires, 361-362 
surveys and, 233 
Pretesting effect, 276 
Pretest-posttest control group design, 
280-281 
Previous research, investigation of, 65 
Price promotions at bars, and 
intoxication, 262 
Pricing decisions, 110—111 
Primary sampling units, 393 
Principles of good interviewing, 452—453 
Privacy 
on Internet, 102 
participant right to, 91-92, 101 
PRIZM, 160, 171, 178 
Probability, definition of, 415 
Probability distribution, 415 
Probability sampling 
cluster, 401, 402 
comparison of techniques of, 405 
description of, 395 
multistage area, 402—404 
proportional compared to 
disproportional, 400—401 
sample size and, 438—439 
simple random, 398-399 
stratified, 400 
systematic, 399 
Probing 
definition of, 114 
personal interviews and, 210 
when no response given, 
448-449, 450 
Problem, definition of, 112 
Problem definition 
business decision and, 112—116 
description of, 108 
gaps in performance and, 112 
importance of, 108 
quality of, 109-111 
steps in process of, 112, 113 
symptoms and, 116, 117 
time spent on, 123 
unit of analysis and, 119 
variables and, 119-120 
writing decision statements and 
objectives, 116-118 
writing objectives and questions, 
120-121 
Procter & Gamble, 135 
Producers of data, 173-178 


Production-oriented firms, 8 
Product-oriented firms, 8 
Product usage, question wording and 
measurement scales for, 377—378 

Projective techniques, 153 
Propensity-weighting method, 408 
Proportion 

definition of, 415 

hypothesis test of, 525 

sample size for, 435—438 

Z-test for comparing, 540-541 
Proportional stratified sampling, 
400-401 
Proposal. See Research proposal 
Proposition, 42 
Proprietary business research, 25 
Protection of participants from harm, 
94, 96 
Pseudo-research, 96—97 
Psychogalvanometer, 252 
Psychology of consumption, 580 
Public opinion research, 177 
Pull technology, 33 
Pupilometer, 252 
Pure research, 7 
Purposive sampling, 396 
Push buttons, 357 
Push polls, 97 
Push technology, 33, 34, 92 
P-values, 510, 512 


Quadrant analysis, 493 
Qualitative analysis, 133 
Qualitative data, 136 
Qualitative research 
case studies, 140 
conversations, 151—152 
definition of, 133 
depth interviews, 150-151 
ethnography, 138-139 
focus group interviews, 141—150 
free-association/sentence 
completion method, 152-154 
grounded theory, 139-140 
misuses of, 154—156 
orientations to, 137 
phenomenology, 137-138 
quantitative research compared to, 
135-136, 156 
techniques of, 141, 142 
uses of, 133-134 
Qualitative responses, coding, 468—471 
Quality 
of data, 21 
definition of, 199 
Quality dimensions for goods and 
services, 202 
Quantified electroencephalography 
(QEEG), 251 
Quantitative data, 136 
Quantitative research, 134-136, 156 
Quasi-experimental designs, 278-280 
Questionnaires. See also Questions; 
Surveys 
about car features, 335 
about climate change, 350 
Agency for Health Care Research 
and Quality case study, 
365-370 
completeness of, and personal 
interviews, 211 
constructing, 343-349 
development stage for, 336 
evaluation of, 363 
flowchart plan for, 351 
for global markets, 362-363 
layout for, 352-361 
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mark-sensed, 477 

McDonald’s Spanish language, 373 

pretesting and revising, 361-362 

quality and design considerations, 
336-337 

response rates to, 221—225 

sample, 484 

sample of completed page from, 451 

self-administered electronic, 225-231 

self-administered mail, 219-225 

sequence of questions in, 349-351 

software to make interactive, 
360-361 

travel case study, 371-372 

types of, 195-196 

wording and measurement scales 
for, 375-384 

Questions 

ambiguity in wording of, 345-346 

assumptions made in, 347 

burdensome, and memory, 347-348 

complexity of, 363 

double-barreled, 346-347 

filter, 350, 466 

to generate variance, 348-349 

language for, 343 

leading and loaded, 344-345 

multiple-grid, 352 

neutral, asking, 449 

objectives of research and, 363 

open-ended compared to fixed- 
alternative, 338-341, 363 

pivot, 350 

for probing, 450 

repeating, 448-449 

rules for asking, 447—448 

sample codes for, 482—483 

selection of statistical techniques 
and, 516 

for self-administered, telephone, 
and personal interview 
surveys, 341-342 

sensitive or potentially embarrassing, 
363 

skip, 354, 356, 466 

Quota sampling, 396-398 
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Radio buttons, 358, 359 
Radio frequency identification (RFID) 
tags, 22, 23 
Raising Cane’s case study, 131 
Random, definition of, 398 
Random digit dialing, 217 
Random digits, table of, 639 
Random error, and sample size, 432—433 
Randomization, 264—265, 280 
Randomized-block design, 284, 555-556 
Randomness, definition of, 398 
Random sampling 
nonsampling errors and, 393-395 
simple, 398-399 
of Web site visitors, 407 
Random sampling error, 188, 203, 
394, 438 
Range, 418-419 
Ranking preferences, 327—328, 331 
Ranking task in attitude 
measurement, 316 
Rank order, calculation of, 496—498 
Rating scales 
advantages and disadvantages of, 326 
balanced or unbalanced, 330 
category, 318, 319, 330 
category labels, 329-330 
composite, 320, 596 
constant-sum, 323 
forced-choice, 330-331 
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graphic, 323-325, 360 
Likert, 303, 318-319, 341 
monadic compared to 
comparative, 329 
numerical, 322 
ranking scales compared to, 331 
semantic differential, 320-321, 
328, 341 
simple attitude, 317 
single measure compared to index 
measure, 331 
Stapel, 322-323, 341 
summated, 318-319 
Thurstone, 325 
Rating task in attitude measurement, 316 
Ratio scales, 300-301 
Raw data, 462 
Raw regression estimates, 567 
Real-time data capture, 229 
Recording responses, 449—450 
Records in data files, 470 
Recruited ad hoc samples, 408 
Refusals, 190 
Regression analysis. See also Multiple 
regression analysis 
equation for, 564, 566 
errors in prediction, 569 
ordinary least-squares method of, 
569-574 
overview of, 564 
parameter estimate choices, 566-567 
visual estimation of simple model, 
567-568 
Regression coefficients in multiple 
regression analysis, 585-586 
Reinterviewing, verification by, 457 
Relativism, ethical, 89—90 
Relevance 
of data, 21, 35 
of questionnaire, 336-337 
Relevant, definition of, 120 
Reliability 
of measurement, 305-307, 309 
of sampling, 388-389 
Reluctant “don’t know” answers, 467 
Repeated measures, 263 
Replication, 154 
Reports 
format of, 611-617 
graphic aids for, 617—625 
on Internet, 626 
oral presentation of, 625-626 
tips for writing, 608 
Representative samples 
Internet surveys and, 228 
telephone interviews and, 217 
Research, definition of, 5—6 
Research analysts, 78 
Research assistants/associates, 78-79 
Research design. 
See also Experimental design 
deception in, 93 
definition of, 66 
influence of decision statements 
on, 123 
planning, 66—68 
secondary-data, 161-163, 171-179 
for surveys, 231-232 
Researcher-dependent research, 133 
Researchers 
as communicators, 609—610 
rights and obligations of, 94—100 
Research firms, largest, 79 
Research follow-up, 627 
Research generalist, 85 
Research methodology section 
of report, 616 
Research objectives, 63. See also 
Objectives 


Research process 
alternatives in, 62—63 
challenges in, 75-76 
defining objectives, 63—66 
drawing conclusions and preparing 
report, 70 
gathering data, 69 
overview of, 61—62 
planning design, 66—68 
processing and analyzing data, 70 
sampling, 68—69 
Research program strategy, 70-71 
Research project, 70-71 
Research proposal 
as anticipating research outcomes, 
127-128 
basic points addressed by, 126 
as contract, 125—127 
description of, 124 
as planning tool, 125 
Research questions, 121—123 
Research reports. See Reports 
Research suppliers, 86 
Resources. See Budget for research 
Respondent error 
definition of, 189 
nonresponse error, 189-191 
response bias, 191-194 
Respondents. See also Participants, 
rights and obligations of; Subjects 
anonymity of, 212, 220, 230 
choosing for focus groups, 145 
definition of, 186 
Response bias, 191—194 
Response latency, 243 
Response rates 
description of, 221-222 
Internet surveys and, 230 
for mail surveys, increasing, 
222-225 
Responses, recording, 449—450 
Results, presentation of, 98, 99 
Results section of report, 616 
Retail Forward, 87 
Return on investment for 
research, 615 
ReTweetability Index, 497 
Reverse coding, 304 
Reverse directory, 393 
Reverse recoding, 319-320 
Revising questionnaires, 361—362 
Ringtones, 165 
R. J. Reynolds, 110 
Robot technology, 55 
Roeder-Johnson Corporation, 333 
Rolling Rock beer, 68 
Royal Bee electric fishing reel, 
236-237 
Rule of parsimony, 595 
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Sales, mixing with research, 95—96 
Salesperson input, 25 
Sample attrition, 277 
Sample bias, 189 
Sample distribution, 424—425, 426 
Sample selection error, 194 
Sample size 
determining on basis of 
judgment, 438 
population size and, 435, 439 
probability sampling and, 438—439 
for proportions, 435—438 
for questions involving means, 
433—435 
random error and, 432—433 
Sample statistics, 413 
Sample survey, 186 


Sampling 
accuracy and reliability of, 
388-389, 404—405 
description of, 68—69, 387 
Internet surveys and, 406—409 
nonprobability, 395-398 
pragmatic reasons for, 387 
probability, 398—404, 408 
random, 393-395, 398-399, 407 
selection of method of, 404—406 
sequential, 434 
stages in, 391 
stratified, 400, 438-439 
target population, defining, 
390, 408 
training interviewers to avoid errors 
in, 454 
verification of plan for, 455—456 
Sampling distribution of sample mean, 
424-425, 426, 427 
Sampling frame error, 393, 394-395 
Sampling frames, 391-393, 411 
Sampling interval, 399 
Sampling services, 392 
Sampling units, 393 
SAS, 499-500, 538, 595 
Scale measurement 
determining which to use, 310 
influence of, on multivariate data 
analysis, 583 
interval scale, 300 
nominal scale, 297—298 
ordinal scale, 299-300 
overview of, 296—297 
ratio scale, 300-301 
types of, 298, 299 
Scales. See also Rating scales; specific 
types of scales 
description of, 295 
mathematical and statistical analysis 
of, 301-303 
Scale values, computing, 303-304 
Scanner-based consumer panels, 250 
Scanner data, 26—27, 28-29 
Scantel Research, 14 
Scarborough Research, 433 
Schönbrunn Palace case study, 
373-374 
Schwinn bicycles, 141 
Scientific decision processes, 155-156 
Scientific method, 7-8, 45—47 
Scientific Telephone Samples, 411 
Scrolling layout, 357 
Search engine, 32 
Secondary data, 161-163, 171-179 
Secondary-data research designs, 
164-170 
Secondary sampling units, 393 
Security issues with Internet 
surveys, 230 
Selection effect, 277 
Selection of course of action, 9-10 
Self-administered questionnaires 
electronic, 225-231 
by mail, 219-225 
Self-efficacy intervention and job 
attitude, 257—260 
Self-selection bias, 191 
Semantic differential scales, 
320-321, 328, 341 
Semi-structured interviews, 151-152 
Send.com ad, 83 
Sensitivity of measurement, 309 
Sentence completion method, 152 
Sequence of questions in 
questionnaires, 349-351 
Sequential sampling, 434 
Service monitoring, 97-98 
Significance level, 510-512 
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Silent probe, 449 
Simple (bivariate) linear 
regression, 564 
Simple-dichotomy questions, 340 
Single-source data, 26-27, 178 
Site analysis techniques, 168-169 
Situation analysis, 112—113 
Skip questions, 354, 356, 466 
Smart agent software, 33 
SMART car, 116 
Snowball sampling, 398 
SOAP (Simple Object Access 
Protocol), 256 
Social desirability bias, 193-194 
Social networking, 152, 228, 497 
Software. See also SPSS 
Askia, 443 
ATLAS.ti, 138 
CHAID, 492 
for data analysis, 499-501 
GUI, 356 
to make questionnaires interactive, 
360-361 
SAS, 499-500, 538, 595 
smart agent, 33 
Sorting task in attitude measurement, 
316, 328 
Sources of data, 171-178 
Speed 
Internet surveys and, 227 
telephone interviews and, 215 
Split-ballot technique, 345 
Split-half method, 306 
Sponsorship of mail surveys, 224 
SPSS (Statistical Package for the Social 
Sciences) 
correlation matrix, 565 
cross-tabulation output, 500 
data file stored in, 471 
data storage terminology in, 470 
factor analysis in, 595 
MANOVA, conducting, 591 
popularity of, 499 
regression results, obtaining in, 587 
reverse coding scales in, 305 
Spyware, 92 
Squishing error, 347-348 


Standard deviation, 419—421, 434 
Standard error, pooled estimate 
of, 535 
Standard error of the mean, 425 
Standardized distribution 
curve, 424 
Standardized normal distribution, 
421-422 


Standardized normal tables, 422 
Standardized regression coefficient 
(B), 566 
Standardized regression estimates, 567 
Standardized research services, 87—88 
Standardized value, computation 
of, 423 
Stapel scales, 322-323, 341 
Starbucks, 4, 5, 14 
Static group design, 279-280 
Statistical Abstract of the United States, 28 
Statistical base, 490 
Statistical databases, 28—29 
Statistical software packages, 499-500. 
See also SAS; SPSS 

Statistical techniques 

determining when to use, 547 

selection of, 516-518 
Statistics, 413, 440 
Status bar, 357 
St. Louis Community College, 213 
Stratified sampling, 400, 438-439 
String characters, 470 
Structuration theory, 41 
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critical values of Pearson correlation 
coefficient, 645 

critical values of T in Wilcoxon 
matched-pairs signed-rank 


Total quality management, 
198-203, 455 

Total variability, 546 

Toyota, 318 


dummy, 585 

establishing control of, 269-270 
experimental, 59 

extraneous, 265, 266, 269-270, 


Structured qualitative responses, 

coding, 469-470 
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